Learn Before
Concept

Types of Training Objectives of Pre-trained LM

  1. Standard Language Model(SLM)
  2. Corrupted Text Reconstruction(CTR)
  3. Full Text Reconstruction(FTR)

0

1

Updated 2022-04-26

Tags

Data Science

Related