Challenges of Multilingual LLMs for Low-Resource Languages
While training LLMs on multilingual data is a powerful approach, a model's performance in a specific language is highly contingent on the volume and quality of the data for that language in the training set. This dependency often results in poor performance for low-resource languages, for which extensive, high-quality data is typically unavailable.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Prep Sessions
Transformer Architecture and Large Language Model Capabilities @ University of Michigan - Ann Arbor
Ch.2 Model Scaling and Capability Evaluation - Transformer Architecture and Large Language Model Capabilities @ University of Michigan - Ann Arbor
Multilingual Language Understanding on MMLU - Transformer Architecture and Large Language Model Capabilities @ University of Michigan - Ann Arbor
Related
Challenges of Multilingual LLMs for Low-Resource Languages
A technology company is developing an AI system to moderate user-generated content from around the world. They are considering two different development strategies:
Strategy 1: Build and maintain a separate, specialized model for each language (e.g., one model for English, one for Japanese, one for Spanish).
Strategy 2: Build and maintain a single, large model trained simultaneously on a massive, combined dataset of all target languages.
Which of the following statements best analyzes the mos
Evaluating LLM Development Strategies
Global Chatbot Development Strategy
Multilingual Benchmark Translation for LLM Evaluation
GPT-4 Multilingual Performance on MMLU
GPT-4
MMLU Benchmark
Challenges of Multilingual LLMs for Low-Resource Languages
Learn After
A company builds a single, large-scale language model by training it on a massive dataset composed of text scraped from the public internet. During testing, the model demonstrates excellent fluency and accuracy for tasks in German, but its performance in the Irish language is poor, characterized by frequent grammatical errors and irrelevant responses. What is the most probable cause for this significant difference in performance?
Evaluating a Chatbot Development Strategy
A multilingual large language model will reliably achieve uniform competence across all languages included in its training mixture.
A development team trains a multilingual large language model on text spanning dozens of languages, but discovers that the model demonstrates poor performance when processing low-resource languages. Explain why this performance disparity occurs and identify the two critical attributes of language-specific training data that determine a model's performance in that language.