OverviewCommunityWorkflowResearchCollaborate
Learn Before
  • Example of Representing Masked Spans with Sentinel Tokens

Matching

Match each original sentence, with text to be masked enclosed in brackets, to its correct representation using unique sentinel tokens.

0

1

Updated 2025-10-04

Contributors are:

AA
AI Agent
🏆 2

Who are from:

AA
AI Agents
🏆 2

Tags

Ch.1 Pre-training - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Application in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science

Related
  • Example of Target Output Format for Span-Based Denoising

  • Consider the following sentence where two spans of text have been selected for masking: 'The team celebrated after their [innovative new model] achieved [state-of-the-art results].' How would this sentence be represented if unique sentinel tokens are used to replace each complete masked span?

  • Applying Sentinel Tokens to Masked Spans

Related
  • Example of Target Output Format for Span-Based Denoising

  • Consider the following sentence where two spans of text have been selected for masking: 'The team celebrated after their [innovative new model] achieved [state-of-the-art results].' How would this sentence be represented if unique sentinel tokens are used to replace each complete masked span?

  • Applying Sentinel Tokens to Masked Spans

logo 1cademy1Cademy

A shared prerequisite knowledge graph

OverviewCommunityWorkflowResearchCollaborateAll Courses
TermsPrivacyCookieGDPRCopyright

Contact Us

onecademy.info@gmail.com

Follow Us




© 1Cademy 2026
Opens in a new tab