Paper Info
Title
Auditory fovea based speech separation and its application to dialog system
Abstract
This paper presents an active direction-pass filter (ADPF) that separates sounds originating from the specified direction by using a pair of microphones. Its application to front-end processing for speech recognition is also reported. Since the performance of sound source separation by the ADPF depends on the accuracy of sound source localization (direction), various localization modules including the interaural phase difference, interaural intensity difference for each sub-band, and other visual and auditory processing are integrated hierarchically. The resulting performance of auditory localization varies according to the relative position of the sound source. The resolution of the center of the robot is much higher than that of peripherals, indicating similar property of visual fovea. To make the best use of this property, the ADPF controls the direction of a head by motor movement. In order to recognize sound streams separated by the ADPF, a hidden Markov model based automatic speech recognition is built with multiple acoustic models trained by the output of the ADPF under different conditions. A preliminary dialog system is thus implemented on an upper-torso humanoid. The experimental results prove that it works well even when two speakers speak simultaneously.
Year
DOI
Venue
2002
10.1109/IRDS.2002.1043937
Intelligent Robots and Systems, 2002. IEEE/RSJ International Conference  
Keywords
Field
DocType
active filters,computer vision,filtering theory,interactive systems,real-time systems,robots,speech recognition,target tracking,active direction-pass filter,auditory fovea,hidden Markov model,human tracking system,humanoid robot,interaural intensity difference,interaural phase difference,mobile robots,real-time system,sound source localization,speech recognition,stereo vision
Computer vision,Computer science,Stereopsis,Speech recognition,Artificial intelligence,Dialog system,Robot,Hidden Markov model,Source separation,Acoustic source localization,Mobile robot,Humanoid robot
Conference
Volume
Citations 
PageRank 
2
17
2.27
References 
Authors
5
3
Name
Order
Citations
PageRank
Kazuhiro Nakadai11342155.91
Hiroshi G. Okuno22092233.19
Hiroaki Kitano33515539.37