Title
Online Sufficient Dimension Reduction Through Sliced Inverse Regression
Abstract
Sliced inverse regression is an effective paradigm that achieves the goal of dimension reduction through replacing high dimensional covariates with a small number of linear combinations. It does not impose parametric assumptions on the dependence structure. More importantly, such a reduction of dimension is sufficient in that it does not cause loss of information. In this paper, we adapt the stationary sliced inverse regression to cope with the rapidly changing environments. We propose to implement sliced inverse regression in an online fashion. This online learner consists of two steps. In the first step we construct an online estimate for the kernel matrix; in the second step we propose two online algorithms, one is motivated by the perturbation method and the other is originated from the gradient descent optimization, to perform online singular value decomposition. The theoretical properties of this online learner are established. We demonstrate the numerical performance of this online learner through simulations and real world applications. All numerical studies confirm that this online learner performs as well as the batch learner.
Year
Venue
Keywords
2020
JOURNAL OF MACHINE LEARNING RESEARCH
Dimension reduction,online learning,perturbation,singular value decomposition,sliced inverse regression,gradient descent
DocType
Volume
Issue
Journal
21
10
ISSN
Citations 
PageRank 
1532-4435
0
0.34
References 
Authors
0
3
Name
Order
Citations
PageRank
Zhanrui Cai100.34
Runze Li211220.80
Liping Zhu300.34