Concept

Ideas from Low-Resource Machine Learning in Non-NLP Communities

Methods in Low Resource settings can be inspired from other areas like Machine Learning and Computer Vision. Some approaches are the following.

Meta-learning: One can identify suitable auxiliary task for which there is a lot of training data available and use the trained model for transfer learning to complete the target task.

Adversarial Training: This training decreases differences in features between the pre-training and the target domain. Therefore, preventing the model from learning a feature-representation specific to a data source. This leads to creation of language independent representations which is a step closer creating a truly multilingual model.

0

1

Updated 2022-07-31

Tags

Natural language processing

Data Science