GloVe

Global Vectors for Word Representation

Abstract

  • Global log-bilinear regression model
  • Combines: (1) global matrix factorization, (2) local context window methods
  • Trains only on non-zero elements in a word-word co-occurence matrix OR on individual context windows in a large corpus
  • Performance of 75% on a recent word analogy task