Title | ||
---|---|---|
Online End-Of-Turn Detection From Speech Based On Stacked Time-Asynchronous Sequential Networks |
Abstract | ||
---|---|---|
This paper presents a novel modeling called stacked time asynchronous sequential networks (STASNs) for online end of -turn detection. An online end-of-turn detection that determines turn-taking points in a real-time manner is an essential component for human-computer interaction systems. In this study, we use long-range sequential information of multiple time-asynchronous sequential features, such as prosodic, phonetic, and lexical sequential features, to enhance online end-of turn detection performance. Our key idea is to embed individual sequential features in a fixed-length continuous representation by using sequential networks. This enables us to simultaneously handle multiple time-asynchronous sequential features for end-of-turn detection. STASNs can embed all of the sequential information between a start-of-conversation and the current end-of-utterance in a fixed-length continuous representation that can be directly used for classification by stacking multiple sequential networks. Experiments show that STASNs outperforms conventional modeling with limited sequential information. Furthermore. STASNs with senone bottleneck features extracted using senone-based deep neural networks have superior performance without requiring lexical features decoded by an automatic speech recognition process. |
Year | DOI | Venue |
---|---|---|
2017 | 10.21437/Interspeech.2017-651 | 18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION |
Keywords | Field | DocType |
online end-of-turn detection, sequential networks, time-asynchronous sequential features, senone bottle-neck features | Asynchronous communication,Pattern recognition,Computer science,Speech recognition,Artificial intelligence | Conference |
ISSN | Citations | PageRank |
2308-457X | 0 | 0.34 |
References | Authors | |
0 | 5 |
Name | Order | Citations | PageRank |
---|---|---|---|
Ryo Masumura | 1 | 25 | 28.24 |
Taichi Asami | 2 | 22 | 10.49 |
Hirokazu Masataki | 3 | 18 | 9.21 |
Ryo Ishii | 4 | 155 | 16.59 |
Ryuichiro Higashinaka | 5 | 341 | 47.27 |