Concept

Joint Training on Both Translation Directions for Leveraging Monolingual Data for Low-Resource NMT

Considering that both the source and target sides may have monolingual data that has valuable information, one can leverage both at once via joint training on the two translation directions. This type of dual learning simultaneously improves the two models on both translation directions by aligning the original monolingual sentences xx and the sentences xx' translated forward and then backward (xyxx \to y' \to x') by the two models. Dual learning can be further improved by introducing multi-agent frameworks for both translation directions. Specific approaches for joint training include iterative back translation, bi-directional NMT, and mirror-generative NMT.

0

1

Updated 2026-06-20

Tags

Deep Learning (in Machine learning)

Data Science

Computing Sciences