True/False

Consider a language model pre-training process that uses a single input sequence (e.g., a pair of sentences) to perform two tasks: predicting masked words and determining if the second sentence logically follows the first. In this process, the model first calculates the loss for the masked word task and updates its internal parameters. Then, using the same input, it calculates the loss for the sentence relationship task and performs a second, separate update to its parameters.

0

1

Updated 2025-10-02

Contributors are:

Who are from:

Tags

Ch.1 Pre-training - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Comprehension in Revised Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science