Title
Blind Source Separation by Entropy Rate Minimization
Abstract
By assuming latent sources are statistically independent, independent component analysis separates underlying sources from a given linear mixture. Since in many applications, latent sources are both non-Gaussian and have sample dependence, it is desirable to exploit both properties jointly. In this paper, we use mutual information rate to construct a general framework for analysis and derivation of algorithms that take both properties into account. We discuss two types of source models for entropy rate estimation-a Markovian and an invertible filter model-and give the general independent component analysis cost function, update rule, and performance analysis based on these. We also introduce four algorithms based on these two models, and show that their performance can approach the Cramér-Rao lower bound. In addition, we demonstrate that the algorithms with flexible models exhibit very desirable performance for “natural” data.
Year
DOI
Venue
2014
10.1109/TSP.2014.2333563
IEEE Transactions on Signal Processing
Keywords
Field
DocType
maximum entropy distribution,markov model,mutual information rate,entropy rate minimization,independent component analysis,linear mixture,cramér-rao lower bound,blind source separation,invertible filter model,independent component analysis cost function,entropy rate estimation
Entropy estimation,Mathematical optimization,Entropy rate,Transfer entropy,Maximum-entropy Markov model,Independent component analysis,Principle of maximum entropy,Blind signal separation,Mathematics,Maximum entropy probability distribution
Journal
Volume
Issue
ISSN
62
16
1053-587X
Citations 
PageRank 
References 
2
0.36
0
Authors
5
Name
Order
Citations
PageRank
Gengshen Fu11027.82
Ronald Phlypo219016.73
Matthew Anderson326314.64
Xi-Lin Li454734.85
Tülay Adali51690126.40