Title
Online sparse Gaussian process regression and its applications.
Abstract
We present a new Gaussian process (GP) inference algorithm, called online sparse matrix Gaussian processes (OSMGP), and demonstrate its merits by applying it to the problems of head pose estimation and visual tracking. The OSMGP is based upon the observation that for kernels with local support, the Gram matrix is typically sparse. Maintaining and updating the sparse Cholesky factor of the Gram matrix can be done efficiently using Givens rotations. This leads to an exact, online algorithm whose update time scales linearly with the size of the Gram matrix. Further, we provide a method for constant time operation of the OSMGP using matrix downdates. The downdates maintain the Cholesky factor at a constant size by removing certain rows and columns corresponding to discarded training examples. We demonstrate that, using these matrix downdates, online hyperparameter estimation can be included at cost linear in the number of total training examples. We describe a robust appearance-based head pose estimation system based upon the OSMGP. Numerous experiments and comparisons with existing methods using a large dataset system demonstrate the efficiency and accuracy of our system. Further, to showcase the applicability of OSMGP to a wide variety of problems, we also describe a regression-based visual tracking method. Experiments show that our OSMGP algorithm generalizes well using online learning.
Year
DOI
Venue
2011
10.1109/TIP.2010.2066984
IEEE Transactions on Image Processing
Keywords
Field
DocType
large dataset system,online algorithm,sparse cholesky factor,osmgp algorithm,online learning,matrix downdates,inference algorithm,online sparse gaussian process,gram matrix,estimation system,online hyperparameter estimation,visual tracking,gaussian process regression,gaussian process,gaussian processes,learning artificial intelligence,sparse matrix,kernel,matrices,covariance matrix,pose estimation,object tracking,cholesky factorization,regression analysis,sparse matrices
Online algorithm,Pattern recognition,Matrix (mathematics),Minimum degree algorithm,Pose,Artificial intelligence,Gaussian process,Kernel method,Sparse matrix,Mathematics,Cholesky decomposition
Journal
Volume
Issue
ISSN
20
2
1941-0042
Citations 
PageRank 
References 
29
1.37
38
Authors
3
Name
Order
Citations
PageRank
Ananth Ranganathan137524.78
Yang Ming-Hsuan215303620.69
Jeffrey Ho32190101.78