Title
Multiple Empirical Kernel Learning with dynamic pairwise constraints
Abstract
Graphical abstractDisplay Omitted HighlightsExisting pairwise constraints (PC) seldomly consider PC dynamically.It might lead to a poor robustness in some cases.A dynamic PC (DPC) selection method is proposed.We firstly introduce (DPC) into the Multiple Empirical Kernel Learning.With the DPC, a superior classification performance is achieved. Unlike the traditional Multiple Kernel Learning (MKL) with the implicit kernels, Multiple Empirical Kernel Learning (MEKL) explicitly maps the original data space into multiple feature spaces via different empirical kernels. MEKL has been demonstrated to bring good classification performance and to be much easier in processing and analyzing the adaptability of kernels for the input space. In this paper, we incorporate the dynamic pairwise constraints into MEKL to propose a novel Multiple Empirical Kernel Learning with dynamic Pairwise Constraints method (MEKLPC). It is known that the pairwise constraint provides the relationship between two samples, which tells whether these samples belong to the same class or not. In the present work, we boost the original pairwise constraints and design the dynamic pairwise constraints which can pay more attention onto the boundary samples and thus to make the decision hyperplane more reasonable and accurate. Thus, the proposed MEKLPC not only inherits the advantages of the MEKL, but also owns multiple folds of prior information. Firstly, MEKLPC gets the side-information and boosts the classification performance significantly in each feature space. Here, the side-information is the dynamic pairwise constraints which are constructed by the samples near the decision boundary, i.e. the boundary samples. Secondly, in each mapped feature space, MEKLPC still measures the empirical risk and generalization risk. Lastly, different feature spaces mapped by multiple empirical kernels can agree to their outputs for the same input sample as much as possible. To the best of our knowledge, it is the first time to introduce the dynamic pairwise constraints into the MEKL framework in the present work. The experiments on a number of real-world data sets demonstrate the feasibility and effectiveness of MEKLPC.
Year
DOI
Venue
2015
10.1016/j.asoc.2015.01.040
Appl. Soft Comput.
Keywords
Field
DocType
pattern recognition
Data set,Artificial intelligence,Hyperplane,Decision boundary,Kernel (linear algebra),Adaptability,Pairwise comparison,Feature vector,Mathematical optimization,Pattern recognition,Multiple kernel learning,Machine learning,Mathematics
Journal
Volume
Issue
ISSN
30
C
1568-4946
Citations 
PageRank 
References 
0
0.34
37
Authors
3
Name
Order
Citations
PageRank
Zhe Wang15020.04
Qi Fan241.74
Daqi Gao311016.30