While multilingual BERT outperforms older task-specific models on C-S tasks, its performance on C-S data is significantly worse than on the same tasks in a monolingual setting. This inefficiency occurs because these models are either not exposed to C-S data at all during training, or they miss out on several language pairs.

University of Michigan - Ann Arbor

Google

language technologies are not yet capable of processing C-S as seamlessly as monolingual data. 

We identify three main limitations of the current state of computational processing of C-S: data, evaluation and user-facing applications.

Computational Approaches to C-S

 multilingual BERT have shown promise in enabling the coverage of lowresource languages without any labeled data by using the zero-shot framework

Massive multilingual Language Models (LMs)

Inefficiency of Multilingual BERT on C-S Tasks

Since C-S languages tend to be low-resourced, building deep learning-based models is challenging due to the lack of large C-S datasets.

Learn Before

Related