Title
Support vector inductive logic programming outperforms the naive Bayes classifier and inductive logic programming for the classification of bioactive chemical compounds.
Abstract
We investigate the classification performance of circular fingerprints in combination with the Naive Bayes Classifier (MP2D), Inductive Logic Programming (ILP) and Support Vector Inductive Logic Programming (SVILP) on a standard molecular benchmark dataset comprising 11 activity classes and about 102,000 structures. The Naive Bayes Classifier treats features independently while ILP combines structural fragments, and then creates new features with higher predictive power. SVILP is a very recently presented method which adds a support vector machine after common ILP procedures. The performance of the methods is evaluated via a number of statistical measures, namely recall, specificity, precision, F-measure, Matthews Correlation Coefficient, area under the Receiver Operating Characteristic (ROC) curve and enrichment factor (EF). According to the F-measure, which takes both recall and precision into account, SVILP is for seven out of the 11 classes the superior method. The results show that the Bayes Classifier gives the best recall performance for eight of the 11 targets, but has a much lower precision, specificity and F-measure. The SVILP model on the other hand has the highest recall for only three of the 11 classes, but generally far superior specificity and precision. To evaluate the statistical significance of the SVILP superiority, we employ McNemar’s test which shows that SVILP performs significantly (p  <  5%) better than both other methods for six out of 11 activity classes, while being superior with less significance for three of the remaining classes. While previously the Bayes Classifier was shown to perform very well in molecular classification studies, these results suggest that SVILP is able to extract additional knowledge from the data, thus improving classification results further.
Year
DOI
Venue
2007
10.1007/s10822-007-9113-3
Journal of computer-aided molecular design
Keywords
Field
DocType
Classification,Feature selection,Machine learning,Molecular similarity,Screening
Inductive logic programming,Naive Bayes classifier,Pattern recognition,Precision and recall,Chemistry,Artificial intelligence,Margin classifier,Probabilistic classification,Bayes error rate,Bayes classifier,Machine learning,Quadratic classifier
Journal
Volume
Issue
ISSN
21
5
0920-654X
Citations 
PageRank 
References 
11
0.76
12
Authors
7
Name
Order
Citations
PageRank
Edward O. Cannon1252.49
Ata Amini2523.11
Andreas Bender368561.10
Michael J. E. Sternberg41049.06
Stephen Muggleton53915619.54
Robert C Glen658961.78
John B O Mitchell738432.48