- Commonsense reasoning
- Dialogue system
- Creative writing


 NLG applications enhanced by knowledge graph

Knowledge graph embedding (KGE) techniques learn node embedding from a KG and that is concatenated with the original word representation.

Incorporate Knowledge Graph Embeddings into Language Generation

Inconsistency in the vector space of entity embeddings and word embeddings paved the way for fine tuning language models directly on knowledge graph triplets.

Transfer Knowledge into Language Model with Knowledge Triplet Information

Path-based methods explore various patterns of connections among entity nodes ,they learn from walkable paths on KGs to provide auxiliary guidance for the generation process.There are two types of path ranking methods 

- Path routing and ranking
- Reinforcement learning based path finding


Perform Reasoning over Knowledge Graph via Path Finding Strategies

Graph-based representations aim at aggregating the context/neighboring information on graph data. They have been applied to both encoding and decoding phases.

Improve the Graph Embeddings with Graph Neural Networks

Knowledge graph is a structured way of representing facts in the form of connections between entities ,relations and semantic descriptions. Different methods to study the relationship between KG and input/output sequences are

- Incorporate Knowledge Graph Embeddings into Language Generation
- Transfer Knowledge into Language Model with Knowledge Triplet Information.
- Perform Reasoning over Knowledge Graph via Path Finding Strategies.
- Improve the Graph Embeddings with Graph Neural Networks


San Jose State University

 -  NLG Enhanced by Knowledge Base
 - NLG Enhanced by Knowledge Graph
 - NLG enhanced by Grounded Text

NLG ENHANCED BY EXTERNAL KNOWLEDGE

A Survey of Knowledge-Enhanced Text Generation

Knowledge base has  large scale information where data is maintained in “factual triplets”. KBs enhance text generation models 

- Design Supervised Tasks around KB for Joint Optimization
- Enhance Incorporation by Selecting KB or Facts in KB


NLG Enhanced by Knowledge Base

NLG Enhanced by Knowledge Graph 

Ground text is the textual data that is not available in any structured form or in any database, these are available in  online resources like encyclopedias, social media , shopping websites.
knowledge grounded text is often taken as an important external knowledge source to help with a variety of NLG applications.

 - Guiding Generation with Retrieved Information
- Modeling Background Knowledge into Response Generation


Learn Before

Related

Learn After