Title
A Time–Frequency Masking Based Random Finite Set Particle Filtering Method for Multiple Acoustic Source Detection and Tracking
Abstract
Considering that multiple talkers may appear simultaneously, a time-frequency (TF) masking based random finite set (RFS) particle filtering (PF) method is developed for multiple acoustic source detection and tracking. The time-delay of arrival (TDOA) measurements of multiple sources are extracted by using a time-frequency masking technique, by which each source's TF bins are clustered and separated in a joint gain-ratio and time-delay histogram. Since a joint detection and tracking problem is considered, both source positions and source numbers are time-varying and need to be estimated. The tracker is built within a RFS Bayesian filtering framework. Essentially, an RFS process is used to characterize the source dynamics that include source appearance/dissappearance and motion trajectories. Latent variables are also introduced to indicate source dynamics and measurement-source associations. Subsequently, a Rao-Blackwellization PF technique is employed so that the source position state can be marginalized and only the latent variables are estimated by using the PF. The main advantage of the proposed approach is that hypothesis-pruning is formulated in a full probabilistic sense. The performance of the proposed approach is demonstrated in real speech recordings as well as in simulated room environments.
Year
DOI
Venue
2015
10.1109/TASLP.2015.2479041
IEEE Transactions on Audio, Speech, and Language Processing
Keywords
Field
DocType
Acoustic source tracking,particle filtering (PF),random finite set (RFS),room reverberation,time-delay of arrival
Speech processing,Histogram,Masking (art),Pattern recognition,Computer science,Particle filter,Speech recognition,Latent variable,Artificial intelligence,Probabilistic logic,Multilateration,Hidden Markov model
Journal
Volume
Issue
ISSN
23
12
2329-9290
Citations 
PageRank 
References 
7
0.46
36
Authors
2
Name
Order
Citations
PageRank
Xionghu Zhong115214.61
James R Hopgood296052.95