Name
Title | ||
|---|---|---|
How To Grade a Test Without Knowing the Answers - A Bayesian Graphical Model for Adaptive Crowdsourcing and Aptitude Testing. |
Abstract | ||
|---|---|---|
We propose a new probabilistic graphical model that jointly models the difficulties of questions, the abilities of participants and the correct answers to questions in aptitude testing and crowdsourcing settings. We devise an active learning/adaptive testing scheme based on a greedy minimization of expected model entropy, which allows a more efficient resource allocation by dynamically choosing the next question to be asked based on the previous responses. We present experimental results that confirm the ability of our model to infer the required parameters and demonstrate that the adaptive testing scheme requires fewer questions to obtain the same accuracy as a static test scenario. |
Year | Venue | Keywords |
|---|---|---|
2012 | ICML | active learning,adaptive testing,graphical model,machine learning,resource allocation |
Field | DocType | Citations |
Active learning,Crowdsourcing,Computer science,Resource allocation,Artificial intelligence,Aptitude,Graphical model,Computerized adaptive testing,Probabilistic logic,Machine learning,Bayesian probability | Conference | 75 |
PageRank | References | Authors |
3.35 | 10 | 4 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Yoram Bachrach | 1 | 1262 | 79.07 |
| Thore Graepel | 2 | 4211 | 242.71 |
| Tom Minka | 3 | 720 | 39.57 |
| John Guiver | 4 | 482 | 21.48 |