A company wants its customer service chatbot, which is powered by a large language model, to provide real-time order tracking information to users. The model was not trained on this specific, dynamic data, and the company wants to avoid the cost and complexity of constantly retraining the model. Which of the following approaches is the best example of using an external tool to enhance the model's capabilities at the time of use?

A language model is generating the next word and has calculated the initial probabilities for five potential tokens: 'mat' (0.45), 'floor' (0.25), 'windowsill' (0.15), 'couch' (0.10), and 'table' (0.05). If the model is configured to only consider the top 3 most probable tokens for the next step, which set of tokens is kept after the ranking and pruning stage?

Analyzing Text Generation Behavior