Title
Hierarchical latent variables structure for topic aware multi-turn conversation
Abstract
Hierarchical structures have emerged as a powerful framework for response generation, which can generate fluent responses in multi-turn conversation. However, the generated responses are often generic and bland. Some researchers have adopted latent variables to improve the diversity of responses, but they can not make full use of the information from multi-turn background, leading to meaningless replies with irrelevant topics. In order to fully utilize the background information for generating diverse and informative responses, we propose a Variational Hierarchical Conversation RNNs model with Topic aware latent variables (VHCR-T). The model contains three levels of latent variables: the global level latent variable to represent background information, the topic level latent variable to capture topic-related information, and the sentence level latent variable to increase the response diversity. When modeling the topic information, we design two different topic level latent variables to maintain the dialog coherence and role preference, and to enhance the context sensitiveness, respectively. Experimental results on Cornell Movie Dialog and Ubuntu Dialog Corpus show that our model outperforms the state-of-the-art models for multi-turn conversation generation in terms of diversity and informativeness, verifying the effectiveness of our VHCR-T model.
Year
DOI
Venue
2022
10.3233/JIFS-211886
JOURNAL OF INTELLIGENT & FUZZY SYSTEMS
Keywords
DocType
Volume
Multi-turn conversation, response generation, hierarchical structure, topic, latent variable
Journal
43
Issue
ISSN
Citations 
3
1064-1246
0
PageRank 
References 
Authors
0.34
0
6
Name
Order
Citations
PageRank
Fuwei Cui111.37
Hui Di211.71
Hui Huang356.60
Kazushige Ouchi412.05
Ze Liu511.03
Jin An Xu61524.50