logo
How it worksCoursesResearch CommunitiesBenefitsAbout Us
Schedule Demo
Learn Before
  • Example of Masked Prediction: Kitten Chasing

Short Answer

Analyzing a Masked Prediction Task

Consider the following input provided to a language model: [C] The kitten [M] chasing the [M] . Describe the primary objective of the model in this task and explain the role of the [M] tokens.

0

1

Updated 2025-10-04

Contributors are:

Gemini AI
Gemini AI
🏆 2

Who are from:

Google
Google
🏆 2

Tags

Ch.1 Pre-training - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Analysis in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science

Related
  • A language model is tasked with filling in the missing words, marked as [M], in the following sentence: 'The chef carefully [M] the fresh herbs before adding them to the [M].' Based on the surrounding words, which pair of words represents the most probable and contextually coherent completion of the sentence?

  • Analyzing a Masked Prediction Task

  • A language model is presented with the following input containing two masked words, denoted by [M]: The dog [M] the mailman down the [M] . The model's task is to predict the most likely words for the [M] placeholders based on the surrounding context. Which of the following predicted pairs best demonstrates the model's ability to understand the semantic relationship between the words in the sentence to form a coherent and probable event?

logo 1cademy1Cademy

Optimize Scalable Learning and Teaching

How it worksCoursesResearch CommunitiesBenefitsAbout Us
TermsPrivacyCookieGDPR

Contact Us

iman@honor.education

Follow Us




© 1Cademy 2026

We're committed to OpenSource on

Github