Name
Title | ||
|---|---|---|
Advanced linguistic explanations of classifier decisions for users' annotation support |
Abstract | ||
|---|---|---|
We propose several new concepts for providing enhanced explanations of classifier decisions in linguistic (human readable) form. These are intended to help operators to better understand the decision process and support them during sample annotation to improve their certainty and consistency in successive labeling cycles. This is expected to lead to better, more consistent data sets (streams) for use in training and updating classifiers. The enhanced explanations are composed of 1) grounded reasons for classification decisions, represented as linguistically readable fuzzy rules, 2) a classifier's level of uncertainty in relation to its decisions and possible alternative suggestions, 3) the degree of novelty of current samples and 4) the levels of impact of the input features on the current classification response. The last of these are also used to reduce the lengths of the rules to a maximum of 3 to 4 antecedent parts to ensure readability for operators and users. The proposed techniques were embedded within an annotation GUI and applied to a real-world application scenario from the field of visual inspection. The usefulness of the proposed linguistic explanations was evaluated based on experiments conducted with six operators. The results indicate that there is approximately an 80% chance that operator/ user labeling behavior improves significantly when enhanced linguistic explanations are provided, whereas this chance drops to 10% when only the classifier responses are shown. |
Year | DOI | Venue |
|---|---|---|
2016 | 10.1109/IS.2016.7737455 | 2016 IEEE 8th International Conference on Intelligent Systems (IS) |
Keywords | Field | DocType |
linguistic explanation of classifier decisions,operators' labeling and annotation behavior,classification reasons,transparent fuzzy rules,classifier certainty,degree of novelty,instance-based feature importance levels | Annotation,Pragmatics,Visualization,Computer science,Fuzzy logic,Readability,Artificial intelligence,Operator (computer programming),Novelty,Classifier (linguistics),Linguistics,Machine learning | Conference |
ISBN | Citations | PageRank |
978-1-5090-1355-5 | 2 | 0.36 |
References | Authors | |
19 | 6 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Edwin Lughofer | 1 | 1940 | 99.72 |
| Roland Richter | 2 | 2 | 0.70 |
| Ulrich Neissl | 3 | 8 | 1.15 |
| Wolfgang Heidl | 4 | 103 | 7.01 |
| Christian Eitzinger | 5 | 164 | 15.33 |
| Thomas Radauer | 6 | 66 | 4.94 |