Title
In-Network Principal Component Analysis with Diffusion Strategies.
Abstract
Principal component analysis (PCA) is a very well-known statistical analysis technique. In its conventional formulation, it requires the eigen-decomposition of the sample covariance matrix. Due to its high-computational complexity and large memory requirements, the estimation of the covariance matrix and its eigen-decomposition do not scale up when dealing with big data, such as in large-scale networks. Numerous studies have been conducted to overcome this issue, often by partitioning the unknown matrix. In this paper, we propose a novel framework for estimating the principal axes, iteratively and in a distributed in-network scheme, without the need to estimate the covariance matrix. To this end, a coupling is operated between criteria for iterative PCA and several strategies for in-network processing. The investigated strategies can be grouped in two classes, noncooperative and cooperative such as information diffusion and consensus strategies. Theoretical results on the performance of these strategies are provided, as well as a convergence analysis. The performance of the proposed approach for in-network PCA is illustrated on diverse applications, such as image processing and time series in wireless sensor networks, with a comparison to state-of-the-art techniques.
Year
DOI
Venue
2016
10.1007/s10776-016-0308-1
IJWIN
Keywords
Field
DocType
Principal component analysis, Network, Adaptive learning, Distributed processing, Dimensionality reduction
Data mining,Dimensionality reduction,Matrix (mathematics),Computer science,Image processing,Real-time computing,Artificial intelligence,Sparse PCA,Principal axis theorem,Covariance matrix,Wireless sensor network,Principal component analysis,Machine learning
Journal
Volume
Issue
ISSN
23
2
1572-8129
Citations 
PageRank 
References 
1
0.35
15
Authors
5
Name
Order
Citations
PageRank
Nisrine Ghadban110.69
Paul Honeine236734.41
Farah Mourad-Chehade376.16
Clovis Francis43411.20
Joumana Farah515817.80