Evaluating Architectural Choices for a Chatbot
Analyze the primary limitation of using a pre-trained model with an encoder-only architecture for the task described in the case study below, and explain your reasoning.
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A research team is building a model designed specifically for summarizing long scientific articles into a few concise paragraphs. The model must be able to process the entire source article to understand its full context before generating the summary. Given this requirement for a sequence-to-sequence task, which architectural approach would be the most effective choice for the model's pre-training and fine-tuning?
Match each architectural approach for self-supervised pre-training with the category of tasks it is primarily designed to handle.
Evaluating Architectural Choices for a Chatbot