Case Study

Diagnosing Semantic Repetition

A language model is generating text for a travel blog. Despite having a mechanism that penalizes the repeated use of specific words, it produces the following output: 'The journey was incredible. The trip was amazing. The expedition was wonderful.' Analyze why the existing penalty mechanism is failing and propose a more effective approach to mitigate this specific type of repetition, explaining the underlying principle of your proposed solution.

0

1

Updated 2025-09-28

Contributors are:

Who are from:

Tags

Ch.2 Generative Models - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Analysis in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science