Evaluating an Inference Strategy for a Creative Writing Assistant

A language model is generating a response, starting with the phrase 'The best way to learn is...'. The model must decide on the next three words. At each step, it uses a strategy where it always chooses the single word with the highest probability. Given the probabilities below, which sequence of three words will the model generate?

Step 1 (after '...is'):

• by: 0.5
• through: 0.3
• with: 0.2

Step 2 (if 'by' is chosen):

• doing: 0.6
• reading: 0.3
• listening: 0.1

Step 3 (if 'by doing' is chosen):

• it: 0.4
• the: 0.5
• a: 0.1

Analyzing a Step-by-Step Text Generation Strategy