step1: training set: large corpus of text

step2: tokenize text--> one-hot encoding --> add <EOS> token

step3: detecting unknown words

step4: start with the first word of the sentence and deed it as input to the RNN.

University of Michigan - Ann Arbor

Given a sequence of words, what is the most probable next word/sentence?

Language Model

Machine Learning Yearning, a free ebook from Andrew Ng, teaches you how to structure Machine Learning projects.
https://www.deeplearning.ai/machine-learning-yearning/

Note: The content of the book is aligned with the Coursera Deeplearning.ai specialization.  https://www.deeplearning.ai/deep-learning-specialization/ 

Machine Learning Yearning (Deeplearning.ai)

Language model with RNN

Language model alignment involves fine-tuning a pretrained language model to follow instructions and align with human intent. Systems like ChatGPT leverage this alignment to allow users to interact conversationally, enabling the model to serve as an assistant for solving complex problems, debugging code, and performing creative writing tasks.

Learn Before

Related