Title
Adaptive Online k-Subspaces with Cooperative Re-Initialization
Abstract
We propose a simple but principled cooperative re-initialization (CoRe) approach to k-subspaces, which also applies to k-means by viewing it as a particular case. CoRe optimizes an ensemble of identical k-subspace models and leverages their aggregate knowledge by greedily exchanging clusters throughout optimization. Further, we introduce an adaptive k-subspaces formulation with split low-rank regularization designed to adapt both the number of subspaces and their dimensions. Moreover, we present a highly scalable online algorithm based on stochastic gradient descent. In experiments on synthetic and real image data, we show that our proposed CoRe method significantly improves upon the standard probabilistic farthest insertion (i.e. k-means++) initialization approach-particularly when k is large. We further demonstrate the improved robustness of our proposed formulation, and the scalability and improved optimization performance of our SGD-based algorithm.
Year
DOI
Venue
2019
10.1109/ICCVW.2019.00082
2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW)
Keywords
DocType
Volume
clustering,PCA,large scale learning,matrix factorization
Conference
2019
Issue
ISSN
ISBN
1
2473-9936
978-1-7281-5024-6
Citations 
PageRank 
References 
1
0.34
20
Authors
3
Name
Order
Citations
PageRank
Connor Lane141.75
Benjamin Haeffele2927.64
rene victor valqui vidal35331260.14