Title
Effective Utilization Of External Knowledge And History Context In Multi-Turn Spoken Language Understanding Model
Abstract
At present, spoken language understanding (SLU) in multi-turn dialogue is a research hotspot, which mainly includes intent detection and slot filling. SLU models trained by large-scale corpus can learn good superficial semantic and grammatical information. But they lack the ability for modeling the knowledge needed to understand language. In order to further understand the deep semantic information of the dialogue, external knowledge needs to be modeled and incorporated into the SLU model. In addition, utilizing the correlation between history dialogue and current utterance is able to understand dialogue in multi-turn SLU. Thus, this paper proposes a joint model of intent detection and slot filling based on history context and external knowledge. This model constructs history dialogue encoder to obtain history context. Meanwhile, it constructs knowledge attention over context module. This module selects external knowledge according to the context information in current utterance and obtains knowledge representation. Finally, the history context and external knowledge representation are incorporated into the intent detection and slot filling joint model. The result of experiments on the common dataset demonstrate that with the help of external knowledge and history context, the performance of our model has a significant improvement.
Year
DOI
Venue
2019
10.1109/BigData47090.2019.9006162
2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA)
Keywords
Field
DocType
external knowledge, intent detection, slot filling, spoken language understanding
Knowledge representation and reasoning,Computer science,Utterance,Semantic information,Artificial intelligence,Encoder,Natural language processing,Hotspot (Wi-Fi),Spoken language,Machine learning
Conference
ISSN
Citations 
PageRank 
2639-1589
0
0.34
References 
Authors
0
5
Name
Order
Citations
PageRank
Yufan Wang100.68
Tingting He2149.19
Rui Fan312.05
Wenji Zhou400.34
Xinhui Tu552.24