https://www.jmlr.org/papers/volume3/bengio03a/bengio03a.pdf

University of Michigan - Ann Arbor

In a simple word,  word embeddings are numerical representations of texts.
In detail, when computer treat differents words, they will turn them into some atomic symbols. e.g. cat might be a, dogs might be b. But how can computer find the relationship between them? That's what word embeddings are. They willl build some relationships between words.

Word Embeddings

A Neural Probabilistic Language Model Paper

Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings Paper

In addition to their ability to learn word meaning from text, embeddings, alas, also reproduce the implicit biases and stereotypes that were latent in the text. As the prior section just showed, embeddings can roughly model relational similarity: ‘queen’ as the closest word to ‘king’ -‘man’ + ‘woman’ implies the analogy man:woman::king:queen.

Learn Before

Related