Title
An efficient orientation distance-based discriminative feature extraction method for multi-classification.
Abstract
Feature extraction is an important step before actual learning. Although many feature extraction methods have been proposed for clustering, classification and regression, very limited work has been done on multi-class classification problems. This paper proposes a novel feature extraction method, called orientation distance–based discriminative (ODD) feature extraction, particularly designed for multi-class classification problems. Our proposed method works in two steps. In the first step, we extend the Fisher Discriminant idea to determine an appropriate kernel function and map the input data with all classes into a feature space where the classes of the data are well separated. In the second step, we put forward two variants of ODD features, i.e., one-vs-all-based ODD and one-vs-one-based ODD features. We first construct hyper-plane (SVM) based on one-vs-all scheme or one-vs-one scheme in the feature space; we then extract one-vs-all-based or one-vs-one-based ODD features between a sample and each hyper-plane. These newly extracted ODD features are treated as the representative features and are thereafter used in the subsequent classification phase. Extensive experiments have been conducted to investigate the performance of one-vs-all-based and one-vs-one-based ODD features for multi-class classification. The statistical results show that the classification accuracy based on ODD features outperforms that of the state-of-the-art feature extraction methods.
Year
DOI
Venue
2014
10.1007/s10115-013-0613-2
Knowl. Inf. Syst.
Keywords
Field
DocType
Multi-class classification, Feature extraction, Support vector machine, One-against-all scheme, One-against-one scheme
Data mining,Computer science,Feature (machine learning),Artificial intelligence,Multiclass classification,k-nearest neighbors algorithm,Feature vector,Pattern recognition,Feature (computer vision),Support vector machine,Feature extraction,Linear discriminant analysis,Machine learning
Journal
Volume
Issue
ISSN
39
2
0219-3116
Citations 
PageRank 
References 
4
0.38
38
Authors
5
Name
Order
Citations
PageRank
Bo Liu117123.67
Yanshan Xiao214323.55
Philip S. Yu322612.27
Zhifeng Hao465378.36
Longbing Cao52212185.04