Name
Abstract | ||
|---|---|---|
The dual purpose principal and minor subspace gradient flow can be used to track principal subspace (PS) and if altered simply by the sign, it can also serve as a minor subspace (MS) trackor. This is of practical significance in the implementations of algorithms. In this paper, a unified information criterion is proposed and a dual purpose principal and minor subspace gradient flow is derived based on the information criterion. In this dual purpose gradient flow, the weight matrix length is self-stabilizing, i.e., moving towards unit length in each learning step. The energy function associated with the dual purpose gradient flow for tracking PS and MS is given, and it exhibits a unique global minimum attained if and only if its state matrices span the PS or MS of the autocorrelation matrix of a vector data stream. The other stationary points of its energy function are (unstable) saddle points. The proposed dual purpose gradient flow can efficiently track an orthonormal basis of the PS or MS, which is illustrated through simulation experiments. |
Year | DOI | Venue |
|---|---|---|
2012 | 10.1109/TSP.2011.2169060 | IEEE Transactions on Signal Processing |
Keywords | Field | DocType |
information criterion,minor subspace,proposed dual purpose gradient,minor subspace gradient flow,energy function,dual purpose gradient flow,principal subspace,state matrix,dual purpose principal,autocorrelation matrix,approximation algorithms,convergence,covariance matrix,gradient flow,algorithm design and analysis,algorithm design,principal component analysis,heuristic algorithm,neural networks,neural network,saddle point,simulation experiment,signal processing | Mathematical optimization,Subspace topology,Matrix (mathematics),Autocorrelation matrix,Stationary point,Orthonormal basis,Covariance matrix,Balanced flow,Mathematics,Principal component analysis | Journal |
Volume | Issue | ISSN |
60 | 1 | 1053-587X |
Citations | PageRank | References |
8 | 0.47 | 33 |
Authors | ||
3 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Xiangyu Kong | 1 | 65 | 15.61 |
| C. H. Chang | 2 | 428 | 36.69 |
| Chongzhao Han | 3 | 446 | 71.68 |