Span Prediction Loss Function

Inference for Span Prediction

Illustration of BERT-based Architecture for Span Prediction

Input Sequence Formatting for Span Prediction

Applying Prediction Networks to Context Token Outputs

An engineer is designing a model to extract answers from a paragraph. The model must identify a continuous segment of text (a 'span') that answers a given question. The model's base component processes the input and produces a contextualized vector representation for each token in the paragraph. Considering the task is to identify the start and end points of the answer, which of the following architectural designs for the final prediction layer is most appropriate?

Debugging a Question-Answering Model Architecture

Comparing Model Architectures for Text Extraction Tasks