Title
Direct optimization of F-measure for retrieval-based personal question answering.
Abstract
Recent advances in spoken language technologies and the introduction of many customer facing products, have given rise to a wide customer reliance on smart personal assistants for many of their daily tasks. In this paper, we present a system to reduce users’ cognitive load by extending personal assistants with long-term personal memory where users can store and retrieve by voice, arbitrary pieces of information. The problem is framed as a neural retrieval based question answering system where answers are selected from previously stored user memories. We propose to directly optimize the end-to-end retrieval performance, measured by the F1-score, using reinforcement learning, leading to better performance on our experimental test set(s).
Year
DOI
Venue
2018
10.1109/slt.2018.8639562
2018 IEEE Spoken Language Technology Workshop (SLT)
Keywords
DocType
Volume
Optimization,Task analysis,Training,Knowledge discovery,Measurement,Speech recognition,Computer architecture
Conference
abs/1810.00679
ISSN
Citations 
PageRank 
2639-5479
0
0.34
References 
Authors
17
6
Name
Order
Citations
PageRank
Rasool Fakoor193.79
Amanjit Kainth200.34
Siamak Shakeri300.34
Christopher Winestock400.34
Abdel-rahman Mohamed53772266.13
Ruhi Sarikaya669864.49