An engineer is developing a system to translate text from a source language to a target language. The system uses a large, pre-trained model as an 'encoder' to process the source sentence and create a rich, contextual numerical representation. A separate, newly trained 'decoder' component then uses this representation to generate the translated sentence. During testing, the engineer observes that the generated sentences in the target language are grammatically fluent and well-structured, but the
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
An engineer is developing a system to translate text from a source language to a target language. The system uses a large, pre-trained model as an 'encoder' to process the source sentence and create a rich, contextual numerical representation. A separate, newly trained 'decoder' component then uses this representation to generate the translated sentence. During testing, the engineer observes that the generated sentences in the target language are grammatically fluent and well-structured, but the
Evaluating Encoder Choices in Machine Translation
Role of the Adapter in BERT-based NMT