Heuristic Search Algorithms for LLM Inference

Stopping Criteria in LLM Inference

Computational Infeasibility of Exhaustive Search in LLM Decoding

A language model is given the prompt 'The capital of France is'. Internally, the model's calculations show that the single most probable next word is 'Paris'. However, the model ultimately generates the sequence 'The capital of France is a beautiful city'. Which statement best analyzes the reason for this discrepancy?

The Challenge of Generating Optimal Text

Analyzing Text Generation Behavior