- Fasttext addresses the issues associated with word2vec .
- Word2vec is not good on words not seen during the training phase.
- Word2vec also fails when the words are too sparse.
- Fasttext uses subword model to address the problems associated with word2vec.

San Jose State University

Other static embeddings available are
- fasttext
- GloVe

 Other kinds of static embeddings

An on-going but a helpful book resource about NLP
https://web.stanford.edu/~jurafsky/slp3/

Speech and Language Processing (3rd ed. draft) 

Fasttext

- Short form for Global Vectors.
- Captures global corpus statistics.
- Based on ratios of probabilities from the word-word co-occurrence matrix, also incorporates linear structure properties from word2vec.

Learn Before

Related