Name
Title | ||
|---|---|---|
What Should You Know? A Human-In-the-Loop Approach to Unknown Unknowns Characterization in Image Recognition |
Abstract | ||
|---|---|---|
ABSTRACT Unknown unknowns represent a major challenge in reliable image recognition. Existing methods mainly focus on unknown unknowns identification, leveraging human intelligence to gather images that are potentially difficult for the machine. To drive a deeper understanding of unknown unknowns and more effective identification and treatment, this paper focuses on unknown unknowns characterization. We introduce a human-in-the-loop, semantic analysis framework for characterizing unknown unknowns at scale. We engage humans in two tasks that specify what a machine should know and describe what it really knows, respectively, both at the conceptual level, supported by information extraction and machine learning interpretability methods. Data partitioning and sampling techniques are employed to scale out human contributions in handling large data. Through extensive experimentation on scene recognition tasks, we show that our approach provides a rich, descriptive characterization of unknown unknowns and allows for more effective and cost-efficient detection than the state of the art. |
Year | DOI | Venue |
|---|---|---|
2022 | 10.1145/3485447.3512040 | International World Wide Web Conference |
Keywords | DocType | Citations |
Unknown unknowns, humans in the loop, semantic analysis | Conference | 0 |
PageRank | References | Authors |
0.34 | 0 | 5 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Shahin Sharifi Noorian | 1 | 0 | 0.34 |
| Sihang Qiu | 2 | 5 | 5.15 |
| Ujwal Gadiraju | 3 | 69 | 8.42 |
| Jie Yang | 4 | 116 | 18.47 |
| Alessandro Bozzon | 5 | 641 | 71.27 |