Joint Training on Both Translation Directions for Leveraging Monolingual Data for Low-Resource NMT
Considering that both the source and target sides may have monolingual data that has valuable information, one can leverage both at once via joint training on the two translation directions. This type of dual learning simultaneously improves the two models on both translation directions by aligning the original monolingual sentences and the sentences translated forward and then backward () by the two models. Dual learning can be further improved by introducing multi-agent frameworks for both translation directions. Specific approaches for joint training include iterative back translation, bi-directional NMT, and mirror-generative NMT.
0
1
Tags
Deep Learning (in Machine learning)
Data Science
Computing Sciences
Related
Back translation and forward translation for leveraging monolingual data for Low-Resource NMT
Unsupervised NMT for leveraging monolingual data for Low-Resource NMT
Language model pre-training for leveraging monolingual data for Low-Resource NMT
Exploiting comparable corpus for leveraging monolingual data for Low-Resource NMT
Enhancing with bilingual dictionary for leveraging monolingual data for Low-Resource NMT
Joint Training on Both Translation Directions for Leveraging Monolingual Data for Low-Resource NMT