Title
Linear combination of densities and its direct estimation framework with applications
Abstract
In this paper, typical learning task including data condensation, binary classification, identification of the independence between random variables and conditional density estimation is described from a unified perspective of a linear combination of densities, and accordingly a direct estimation framework based on a linear combination of Gaussian components (i.e., Gaussian basis functions) under integrated square error criterion is proposed to solve these learning tasks. The proposed direct estimation framework has three advantages. Firstly, different from most of the existing state-of-the-art methods in which estimating each component's density in this linear combination of densities and then combining them linearly are required, it can directly estimate the linear combination of densities as a whole, and it has at least comparable to or even better approximation accuracy than the existing density estimation methods. Secondly, the time complexity of the proposed direct estimation framework is O(l3) in which l is the number of Gaussian components in this framework which are generally viewed as the Gaussian distributions of the clusters in a dataset, and hence l is generally much less than the size of the dataset, so it is very suitable for large datasets. Thirdly, this proposed framework can be typically used to develop alternative approaches to classification, data condensation, identification of the independence between random variables, conditional density estimation and the similarity identification between multiple source domains and a target domain. Our preliminary results about experiments on several typical applications indicate the power of the proposed direct estimation framework.
Year
DOI
Venue
2016
10.1007/s00521-015-1947-3
Neural Computing and Applications
Keywords
Field
DocType
Probability density estimation, Linear combination of densities, Difference of densities, Classification, Conditional density estimation, Multiple source domains and target domain
Density estimation,Linear combination,Cluster (physics),Random variable,Pattern recognition,Binary classification,Gaussian,Basis function,Artificial intelligence,Time complexity,Mathematics
Journal
Volume
Issue
ISSN
27
6
1433-3058
Citations 
PageRank 
References 
1
0.34
19
Authors
4
Name
Order
Citations
PageRank
Min Xu111418.03
guanjin wang2525.73
Fu Lai Chung3153486.72
Shitong Wang41485109.13