Learn Before
Rationale for Combined Input Sequence
When preparing input for a model that identifies an answer span within a context document based on a query, the query and context are typically combined into a single sequence using a special separator token (e.g., [SEP]). Explain the primary reason why this specific structure (query [SEP] context [SEP]) is used instead of feeding the query and context to the model as two separate, independent inputs.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A language model is designed to find an answer by identifying a specific segment of text (a 'span') within a larger context, based on a given query. If the query is 'What is the capital of France?' and the context is 'Paris is the capital and most populous city of France.', which of the following shows the correctly formatted single input sequence that should be fed into the model?
A language model designed for span-based question answering needs the query and the context document to be combined into a single input string. Arrange the following components into the correct structural order.
Rationale for Combined Input Sequence