Title
The Label Complexity of Mixed-Initiative Classifier Training.
Abstract
Mixed-initiative classifier training, where the human teacher can choose which items to label or to label items chosen by the computer, has enjoyed empirical success but without a rigorous statistical learning theoretical justification. We analyze the label complexity of a simple mixed-initiative training mechanism using teaching dimension and active learning. We show that mixed-initiative training is advantageous compared to either computer-initiated (represented by active learning) or human-initiated classifier training. The advantage exists across all human teaching abilities, from optimal to completely unhelpful teachers. We further improve classifier training by educating the human teachers. This is done by showing, or explaining, optimal teaching sets to the human teachers. We conduct Mechanical Turk human experiments on two stylistic classifier training tasks to illustrate our approach.
Year
Venue
Field
2016
ICML
Active learning,Teaching dimension,Computer science,Statistical learning,Artificial intelligence,Classifier (linguistics),Machine learning
DocType
Citations 
PageRank 
Conference
3
0.40
References 
Authors
16
3
Name
Order
Citations
PageRank
Jina Suh117810.04
Xiaojin Zhu23586222.74
Saleema Amershi377545.16