Title
Efficient Iterative Semi-supervised Classification on Manifold
Abstract
Semi-Supervised Learning (SSL) has become a topic of recent research that effectively addresses the problem of limited labeled data. Many SSL methods have been developed based on the manifold assumption, among them, the Local and Global Consistency (LGC) is a popular method. The problem with most of these algorithms, and in particular with LGC, is the fact that their naive implementations do not scale well to the size of data. Time and memory limitations are the major problems faced in large-scale problems. In this paper, we provide theoretical bounds on gradient descent, and to overcome the aforementioned problems, a new approximate Newton's method is proposed. Moreover, convergence analysis and theoretical bounds for time complexity of the proposed method is provided. We claim that the number of iterations in the proposed methods, logarithmically depends on the number of data, which is a considerable improvement compared to the naive implementations. Experimental results on real world datasets confirm superiority of the proposed methods over LGC's default iterative implementation and the state of the art factorization method.
Year
DOI
Venue
2011
10.1109/ICDMW.2011.181
ICDM Workshops
Keywords
Field
DocType
Newton method,gradient methods,learning (artificial intelligence),pattern classification,approximate Newton method,factorization method,gradient descent,iterative semisupervised classification,limited labeled data,local and global consistency,manifold assumption,semisupervised learning,Convergence analysis,Iterative method,Local and global consistency,Manifold assumption,Semi-supervised learning
Convergence (routing),Gradient descent,Semi-supervised learning,Computer science,Iterative method,Implementation,Artificial intelligence,Time complexity,Machine learning,Manifold,Newton's method
Conference
Citations 
PageRank 
References 
2
0.37
0
Authors
4
Name
Order
Citations
PageRank
Mehrdad Farajtabar123020.70
Hamid R. Rabiee233641.77
Amirreza Shaban3485.60
Ali Soltani-Farani441.09