Specialized architecture models are designed to incorporate particular knowledge into the text generation models. The various neural network models used to enhance the knowledge are

• Knowledge-related Attention Mechanism
• Knowledge-related mode in Copy and Pointing Mechanisms
• Knowledge-related Memory Network
• Graph Network
• Pre-trained Language Models