Learn Before
Improving Model Coherence
A developer observes that their language model generates responses that are grammatically correct but often lack logical flow, with sentences that don't connect coherently. Based on methods for training models to understand text structure, describe a specific training task the developer could implement to address this issue and explain why this task would be effective.
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A model is being trained to understand the logical flow of text by learning to restore the original order of sentences from a shuffled sequence. Which of the following training data pairs correctly represents this task?
A language model is trained to restore the original order of shuffled sentences to learn about logical coherence. Below is a set of sentences that have been shuffled. Arrange them in the most logical and coherent order.
Improving Model Coherence