Title
Almost random projection machine with margin maximization and kernel features
Abstract
Almost Random Projection Machine (aRPM) is based on generation and filtering of useful features by linear projections in the original feature space and in various kernel spaces. Projections may be either random or guided by some heuristics, in both cases followed by estimation of relevance of each generated feature. Final results are in the simplest case obtained using simple voting, but linear discrimination or any other machine approach may be used in the extended space of new features. New feature is added as a hidden node in a constructive network only if it increases the margin of classification, measured by the increase of the aggregated activity of nodes that agree with the final decision. Calculating margin more weight is put on vectors that are close to the decision threshold than on those classified with high confidence. Training is replaced by network construction, kernels that provide different resolution may be used at the same time, and difficult problems that require highly complex decision borders may be solved in a simple way. Relation of this approach to Support Vector Machines and Liquid State Machines is discussed.
Year
DOI
Venue
2010
10.1007/978-3-642-15822-3_5
ICANN (2)
Keywords
Field
DocType
support vector machines,original feature space,useful feature,final decision,random projection machine,kernel feature,liquid state machines,extended space,constructive network,margin maximization,new feature,complex decision border,decision threshold,liquid state machine,neural network,support vector machine,boosting,feature space,machine learning,neural networks
Kernel (linear algebra),Random projection,Feature vector,Pattern recognition,Computer science,Support vector machine,Finite-state machine,Boosting (machine learning),Artificial intelligence,Relevance vector machine,Artificial neural network,Machine learning
Conference
Volume
ISSN
ISBN
6353
0302-9743
3-642-15821-8
Citations 
PageRank 
References 
1
0.35
13
Authors
2
Name
Order
Citations
PageRank
tomasz maszczyk1425.29
Włodzisław Duch229128.95