Title
Low-Latency Real-Time Meeting Recognition and Understanding Using Distant Microphones and Omni-Directional Camera
Abstract
This paper presents our real-time meeting analyzer for monitoring conversations in an ongoing group meeting. The goal of the system is to recognize automatically “who is speaking what” in an online manner for meeting assistance. Our system continuously captures the utterances and face poses of each speaker using a microphone array and an omni-directional camera positioned at the center of the meeting table. Through a series of advanced audio processing operations, an overlapping speech signal is enhanced and the components are separated into individual speaker's channels. Then the utterances are sequentially transcribed by our speech recognizer with low latency. In parallel with speech recognition, the activity of each participant (e.g., speaking, laughing, watching someone) and the circumstances of the meeting (e.g., topic, activeness, casualness) are detected and displayed on a browser together with the transcripts. In this paper, we describe our techniques and our attempt to achieve the low-latency monitoring of meetings, and we show our experimental results for real-time meeting transcription.
Year
DOI
Venue
2012
10.1109/TASL.2011.2164527
IEEE Transactions on Audio, Speech & Language Processing
Keywords
Field
DocType
real time systems,speaker diarization,low latency,speech,speaker recognition,speech processing,speech recognition,real time
Speech enhancement,Speech processing,Computer science,Communication channel,Microphone array,Speech recognition,Speaker recognition,Speaker diarisation,Latency (engineering),Audio signal processing
Journal
Volume
Issue
ISSN
20
2
1558-7916
Citations 
PageRank 
References 
31
1.77
39
Authors
13
Name
Order
Citations
PageRank
T. Hori1342.83
Shoko Araki21726158.79
Takuya Yoshioka358549.20
Masakiyo Fujimoto439334.28
Shinji Watanabe51158139.38
T. Oba6311.77
A. Ogawa7311.77
K. Otsuka8311.77
Dan Mikami911817.60
Keisuke Kinoshita1049454.81
Tomohiro Nakatani111327139.18
Atsushi Nakamura12967.76
J. Yamato13311.77