Language models are probabilistic models that are capable of predicting the next word given the preceding words in a sequence. There is evidence for the ability of language models to model sequential data of fixed length context using feed forward neural networks.

Conditional language models are also used as a variant of language models where the language model is conditioned on variables other than the preceding words, like the work done by generating product reviews based on sentiment, author, item or category or generating text with emotional context.