Short Answer

Resource Consumption in Text Generation

A developer is tuning a text generation system. They have two configurations:

  • Configuration A: At each step of generating text, the system considers only the 3 most likely next words.
  • Configuration B: At each step, the system considers the 100 most likely next words.

Describe two specific computational resources that will be more heavily consumed by Configuration B compared to Configuration A, and briefly explain why for each.

0

1

Updated 2025-10-06

Contributors are:

Who are from:

Tags

Ch.5 Inference - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Application in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science