The dialogue response generation is a challenging task in chatbot applications. Recently neuralnetwork-based dialogue models, including the sequence-to-sequence model and the RNN language models, are able to generate fluent and grammatically compliant responses, while there is a major limitation that most of the responses generated by these models are of chitchat style instead of being informative. After investigating the currently used models, we found that one primary challenge is to model and generate informative words, such as named entities, especially when the entities have sparsely existed in training corpus. To address this problem, we propose to augment neural network-based generative architecture with knowledge embedding and knowledge attentive reader to incorporate external textual knowledge into the dialogue model to facilitate the dialogue modeling and generation. We evaluate the model with the Ubuntu dataset through automatic evaluation metrics and human evaluation. The experimental study has shown our methods outperform strong baselines in multiple metrics. We also visualize how the attention works in the dialogue context to verify the effectiveness of knowledge attentive reader mechanism. INDEX TERMS Dialogue response generation, unstructured knowledge, knowledge embedding, attentive reader.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.