Name
Title | ||
|---|---|---|
Improvement of robot audition by interfacing sound source separation and automatic speech recognition with Missing Feature Theory |
Abstract | ||
|---|---|---|
We have been developed robot audition system using the active direction-pass filter (ADPF) with the Scattering Theory, and demonstrated that the humanoid SIG could separate and recognize three simultaneous speeches originating from different directions. This is the first result that a robot can listen to several things simultaneously. However, its general applicability to other robots is not yet confirmed. Since automatic speech recognition (ASR) requires direction- and speaker-dependent acoustic models, it is difficult to adapt various kinds of envi- ronments. In addition ASR with lots of acoustic models causes slow processing. In this paper, these three problems are resolved. First, we confirmed the generality of the ADPF by applying it to two humanoids, SIG2 and Replie, under different environments. Next, we present the new interface between ADPF and ASR based on the Missing Feature Theory, which masks broken features of separated sound to make them unavailable to ASR. This new interface improved the recognition performance of three simultaneous speeches up to about 90%. Finally, since the ASR uses only a single acoustic model that is direction- and speaker-independent and created under clean environments, the processing of the whole system was made very light and fast. |
Year | DOI | Venue |
|---|---|---|
2004 | 10.1109/ROBOT.2004.1308039 | Robotics and Automation, 2004. Proceedings. ICRA '04. 2004 IEEE International Conference |
Keywords | Field | DocType |
active filters,filtering theory,robots,source separation,speech processing,speech recognition,Replie humanoid robot,SIG2 humanoid robot,active direction pass filter,automatic speech recognition,direction dependent acoustic models,missing feature theory,robot audition system,sound source separation,speaker dependent acoustic models | Speech processing,Active filter,Interfacing,Speech recognition,Robot audition,Engineering,Robot,Generality,Source separation,Acoustic model | Conference |
Volume | ISSN | ISBN |
2 | 1050-4729 | 0-7803-8232-3 |
Citations | PageRank | References |
15 | 1.04 | 11 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Yamamoto, S. | 1 | 15 | 1.04 |
| Kazuhiro Nakadai | 2 | 1342 | 155.91 |
| Tsujino, H. | 3 | 15 | 1.38 |
| Yokoyama, T. | 4 | 15 | 1.04 |