Cross-Lingual Learning

Bilingual Pre-training for Multilingual Models

Benefit of Multilingual Pre-trained Models: Handling Code-Switching

Shared Vocabulary in Multilingual Models

Factors Influencing Multilingual Pre-training

A company is developing a sentiment analysis tool. Their primary market is in France, for which they have a massive, high-quality dataset. They also need to provide functional support for Spanish and German, but have very limited data for these languages. The highest priority is achieving state-of-the-art performance for the French market, while still being able to handle the other languages. Given these requirements, which strategy for choosing a foundational model is most appropriate?

Model Selection for a Monolingual Task

Match each pre-trained model with the description that best characterizes its training methodology and primary use case.

Models of Code Switching

Why Speakers Code-Switch

Example of Code-Switching between Chinese and English

Benefit of Multilingual Pre-trained Models: Handling Code-Switching

A user is sending text messages that mix two different languages. Which of the following messages best exemplifies the practice of alternating between languages within a single, coherent thought or sentence?

Diagnosing NLP Model Failure

Defining and Illustrating Code-Switching

Language-Independent Token Representations