Title
Dialogue Environments Are Different From Games: Investigating Variants Of Deep Q-Networks For Dialogue Policy
Abstract
The dialogue manager is an important component in a task-oriented dialogue system, which focuses on deciding dialogue policy given the dialogue state in order to fulfill the user goal. Learning dialogue policy is usually framed as a reinforcement learning (RL) problem, where the objective is to maximize the reward indicating whether the conversation is successful and how efficient it is. However, even there are many variants of deep Q-networks (DQN) achieving better performance on game playing scenarios, no prior work analyzed the performance of dialogue policy learning using these improved versions. Considering that dialogue interactions differ a lot from game playing, this paper investigates variants of DQN models together with different exploration strategies in a benchmark experimental setup, and then we examine which RL methods are more suitable for task-completion dialogue policy learning(1).
Year
DOI
Venue
2019
10.1109/ASRU46091.2019.9003840
2019 IEEE AUTOMATIC SPEECH RECOGNITION AND UNDERSTANDING WORKSHOP (ASRU 2019)
Keywords
DocType
Citations 
dialogue policy, reinforcement learning, deep Q-Networks, exploration
Conference
0
PageRank 
References 
Authors
0.34
0
2
Name
Order
Citations
PageRank
Yu-An Wang100.68
Yun-Nung Chen232435.41