Analyzing Performance Gaps in Multilingual Models
A technology firm is developing a single, large language model trained on a vast corpus of text from the internet, with the goal of creating a universal translation and content generation tool. The training data is predominantly in English (60%), with smaller portions of Spanish, French, and Mandarin (10% each), and a very small fraction of Swahili (less than 0.1%). Analyze the specific types of performance issues the model is likely to exhibit when processing Swahili, and explain the fundamental reasons for these anticipated shortcomings based on the principles of model training.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A company builds a single, large-scale language model by training it on a massive dataset composed of text scraped from the public internet. During testing, the model demonstrates excellent fluency and accuracy for tasks in German, but its performance in the Irish language is poor, characterized by frequent grammatical errors and irrelevant responses. What is the most probable cause for this significant difference in performance?
Evaluating a Chatbot Development Strategy
Analyzing Performance Gaps in Multilingual Models