Title | ||
---|---|---|
Machine Self-Confidence in Autonomous Systems via Meta-Analysis of Decision Processes. |
Abstract | ||
---|---|---|
Algorithmic assurances assist human users in trusting advanced autonomous systems appropriately. This work explores one approach to creating assurances in which systems self-assess their decision-making capabilities, resulting in a 'self-confidence' measure. We present a framework for self-confidence assessment and reporting using meta-analysis factors, and then develop a new factor pertaining to 'solver quality' in the context of solving Markov decision processes (MDPs), which are widely used in autonomous systems. A novel method for computing solver quality self-confidence is derived, drawing inspiration from empirical hardness models. Numerical examples show our approach has desirable properties for enabling an MDP-based agent to self-assess its performance for a given task under different conditions. Experimental results for a simulated autonomous vehicle navigation problem show significantly improved delegated task performance outcomes in conditions where self-confidence reports are provided to users. |
Year | DOI | Venue |
---|---|---|
2018 | 10.1007/978-3-030-20454-9_21 | ADVANCES IN ARTIFICIAL INTELLIGENCE, SOFTWARE AND SYSTEMS ENGINEERING |
Keywords | Field | DocType |
Human-Machine systems,Artificial intelligence,Self-assessment | Computer science,Markov decision process,Factorization,Autonomous system (Internet),Artificial intelligence,Self-confidence,Decision process,Solver,Robotics,Reinforcement learning | Journal |
Volume | ISSN | Citations |
965 | 2194-5357 | 0 |
PageRank | References | Authors |
0.34 | 0 | 5 |
Name | Order | Citations | PageRank |
---|---|---|---|
Brett W. Israelsen | 1 | 0 | 0.34 |
Nisar Ahmed | 2 | 29 | 6.65 |
Eric W. Frew | 3 | 182 | 26.73 |
Dale Lawrence | 4 | 95 | 8.62 |
Brian Argrow | 5 | 34 | 7.96 |