Various bias can be learned by LM when it's trained on the data containing human discrimination. Researchers have tried using fixed rules or specific models to eliminate bias and used it for mitigating bias contained in the LM.

University of Michigan - Ann Arbor

It's widely used in Low-Resource NMT, Mitigating Bias, Fixing Class Imbalance, Few-shot Learning, and Adversarial Examples (AVEs).

Applications of DA in NLP

https://arxiv-download.xixiaoyao.cn/pdf/2105.03075.pdf

A Survey of Data Augmentation Approaches for NLP

Low-resource languages are an important and challenging application for DA, typically for neural machine translation (NMT). Using WordNet, backtranslation and etc is proved to be successful on Low-Resource NMT.

DA in Low-Resource NMT

DA in Mitigating Bias

Fixing class imbalance typically involves a combination of undersampling and oversampling.

DA in Fixing Class Imbalance

DA methods can ease few-shot learning by adding more examples for novel classes introduced in the few-shot phase. 

DA in Few-shot Learning

Adversarial examples can be generated using innocuous label-preserving transformations (e.g. paraphrasing) that fool state-of-the-art NLP models

Learn Before

Related