Title
Machine Self-Confidence in Autonomous Systems via Meta-Analysis of Decision Processes.
Abstract
Algorithmic assurances assist human users in trusting advanced autonomous systems appropriately. This work explores one approach to creating assurances in which systems self-assess their decision-making capabilities, resulting in a 'self-confidence' measure. We present a framework for self-confidence assessment and reporting using meta-analysis factors, and then develop a new factor pertaining to 'solver quality' in the context of solving Markov decision processes (MDPs), which are widely used in autonomous systems. A novel method for computing solver quality self-confidence is derived, drawing inspiration from empirical hardness models. Numerical examples show our approach has desirable properties for enabling an MDP-based agent to self-assess its performance for a given task under different conditions. Experimental results for a simulated autonomous vehicle navigation problem show significantly improved delegated task performance outcomes in conditions where self-confidence reports are provided to users.
Year
DOI
Venue
2018
10.1007/978-3-030-20454-9_21
ADVANCES IN ARTIFICIAL INTELLIGENCE, SOFTWARE AND SYSTEMS ENGINEERING
Keywords
Field
DocType
Human-Machine systems,Artificial intelligence,Self-assessment
Computer science,Markov decision process,Factorization,Autonomous system (Internet),Artificial intelligence,Self-confidence,Decision process,Solver,Robotics,Reinforcement learning
Journal
Volume
ISSN
Citations 
965
2194-5357
0
PageRank 
References 
Authors
0.34
0
5
Name
Order
Citations
PageRank
Brett W. Israelsen100.34
Nisar Ahmed2296.65
Eric W. Frew318226.73
Dale Lawrence4958.62
Brian Argrow5347.96