Title
Benchmarking data mining methods in CAT
Abstract
In this study, a ranking test problem of Computer Adaptive Testing (CAT) is benchmarked by employing three popular classifiers: Artificial Neural Network (ANN), Support Vector Machines (SVMs), and Adaptive Network Based Fuzzy Inference System (ANFIS) in terms of ordinal classification performances. As the pilot test, "History of Civilization" class which offered in Bahcesehir University is selected. Item Response Theory (IRT) is focused for the determination of system inputs which are item responses of students, item difficulties of questions, and question levels. Item difficulties of questions are Gaussian normalized to make ordinal decisions. The distance between predicted and expected class values is employed for accuracy estimation. Comparison study is conducted to the ordinal class prediction correctness and performance analysis which is observed by Receiver Operating Characteristic (ROC) graphs. The results show that ANFIS has better performance and higher accuracy than ANN and SVMs in terms of ordinal question classification when the ordinal decisions are practically made by Gaussian Normal Distribution and ROC graphs are focused to observe any significant difference among the performances of classifiers.
Year
DOI
Venue
2011
10.1007/978-3-642-25944-9_94
ICIC (2)
Keywords
Field
DocType
computer adaptive testing,ordinal decision,ordinal question classification,item difficulty,adaptive network,expected class value,artificial neural network,item response,ordinal class prediction correctness,benchmarking data mining method,ordinal classification performance
Data mining,Computer science,Artificial intelligence,Adaptive neuro fuzzy inference system,Artificial neural network,Pattern recognition,Ranking,Ordinal number,Support vector machine,Gaussian,Computerized adaptive testing,Item response theory,Machine learning
Conference
Volume
ISSN
Citations 
6839
0302-9743
0
PageRank 
References 
Authors
0.34
18
3
Name
Order
Citations
PageRank
Ibrahim Furkan Ince1134.13
Adem Karahoca29715.26
Dilek Karahoca3648.88