Language Model Development Strategy
Based on the case study provided, which of the two following strategies would you recommend for developing the necessary language models? Justify your recommendation by evaluating the trade-offs in the context of the company's resources and goals.
Strategy 1: Train a separate, specialized model for each of the three languages. Strategy 2: Train a single, unified model using a combined dataset from all three languages.
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Multi-lingual BERT (mBERT)
Multilingual and Language-Specific PTMs
Language Model Development Strategy
A startup with limited computational resources is developing a feature to classify customer support tickets across 20 different languages. Several of these are low-resource languages with small datasets. Considering the trade-offs between performance, cost, and data availability, which strategy for building the underlying language model is most advisable?
A team is developing a natural language processing system for a global audience. They are considering two different strategies for handling multiple languages. Match each strategy with its most significant trade-off.