One way is to discover topics using generative topic models (e.g., LDA), Incorporate the topics representations into neural generation models

Second way is to assign a topic to each sentence and then find out the top-k words falling into that topic and use word embeddings to represent the topic words.