1. Pre-Trained Language Representations
2. Domain-Specific Pre-Training
3. Multilingual Language Models

University of Michigan - Ann Arbor

Transfer learning in NLP lies in the use of pre-trained language representations that are trained on unlabeled data like BERT. Some brand new finetuning and probing paradigms are also proposed in recent years for the direction.

Transfer Learning for Low-resource NLP

https://aclanthology.org/2021.naacl-main.201.pdf

Learn Before

Related