A model is being trained on a denoising task where corrupted text spans are replaced by unique sentinel tokens. If the model receives the input The [X] fox jumps over [Y] dog., what should the corresponding target output be to correctly associate [X] with 'quick brown' and [Y] with 'the lazy'?

Constructing Target Output for Span-Based Denoising

A language model is being trained on a span-based denoising task where corrupted text spans are replaced by unique sentinel tokens. Match each corrupted input sentence on the left with its correctly formatted target output on the right.