Title
Online Semantic Parsing for Latency Reduction in Task-Oriented Dialogue
Abstract
Standard conversational semantic parsing maps a complete user utterance into an executable program, after which the program is executed to respond to the user. This could be slow when the program contains expensive function calls. We investigate the opportunity to reduce latency by predicting and executing function calls while the user is still speaking. We introduce the task of online semantic parsing for this purpose, with a formal latency reduction metric inspired by simultaneous machine translation. We propose a general framework with first a learned prefix-to-program prediction module, and then a simple yet effective thresholding heuristic for subprogram selection for early execution. Experiments on the SMCalFlow and TreeDST datasets show our approach achieves large latency reduction with good parsing quality, with a 30%-63% latency reduction depending on function execution time and allowed cost.
Year
DOI
Venue
2022
10.18653/v1/2022.acl-long.110
PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS)
DocType
Volume
Citations 
Conference
Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
0
PageRank 
References 
Authors
0.34
0
5
Name
Order
Citations
PageRank
Jiawei Zhou100.68
Jason Eisner200.34
Michael Newman38015.00
Emmanouil Antonios Platanios401.69
Sam Thomson5384.82