Title
Online End-Of-Turn Detection From Speech Based On Stacked Time-Asynchronous Sequential Networks
Abstract
This paper presents a novel modeling called stacked time asynchronous sequential networks (STASNs) for online end of -turn detection. An online end-of-turn detection that determines turn-taking points in a real-time manner is an essential component for human-computer interaction systems. In this study, we use long-range sequential information of multiple time-asynchronous sequential features, such as prosodic, phonetic, and lexical sequential features, to enhance online end-of turn detection performance. Our key idea is to embed individual sequential features in a fixed-length continuous representation by using sequential networks. This enables us to simultaneously handle multiple time-asynchronous sequential features for end-of-turn detection. STASNs can embed all of the sequential information between a start-of-conversation and the current end-of-utterance in a fixed-length continuous representation that can be directly used for classification by stacking multiple sequential networks. Experiments show that STASNs outperforms conventional modeling with limited sequential information. Furthermore. STASNs with senone bottleneck features extracted using senone-based deep neural networks have superior performance without requiring lexical features decoded by an automatic speech recognition process.
Year
DOI
Venue
2017
10.21437/Interspeech.2017-651
18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION
Keywords
Field
DocType
online end-of-turn detection, sequential networks, time-asynchronous sequential features, senone bottle-neck features
Asynchronous communication,Pattern recognition,Computer science,Speech recognition,Artificial intelligence
Conference
ISSN
Citations 
PageRank 
2308-457X
0
0.34
References 
Authors
0
5
Name
Order
Citations
PageRank
Ryo Masumura12528.24
Taichi Asami22210.49
Hirokazu Masataki3189.21
Ryo Ishii415516.59
Ryuichiro Higashinaka534147.27