Title
Fostering Progress in Performance Evaluation and Benchmarking of Robotic and Automation Systems [TC Spotlight].
Abstract
We have shared benchmarks for many engineering systems and products in the market that can be used to compare solutions and systems. We can compare cars in terms of maximum speed, acceleration, and maximum torque; computers in terms of flops, random access memory, and hard disk capacity; and smartphones in terms of battery life and screen dimensions. We also have shared usability metrics based on human factors, which are used to compare the ease of use of different software interfaces. When we come to the evaluation and the comparison of how intelligent, robust, adaptive, and antifragile the behaviors of robots are in performing a given set of tasks, such as daily life activities with daily life objects such as in a kitchen or a hospital room, we are in trouble.
Year
DOI
Venue
2014
10.1109/MRA.2014.2298363
Robotics & Automation Magazine, IEEE  
Keywords
Field
DocType
Robot kinematics,Benchmark testing,Automation,Robot sensing systems,Performance evaluation
Simulation,Usability,Personal robot,Automation,Software,Artificial intelligence,Engineering,Benchmarking,Robotics,Benchmark (computing),Random access
Journal
Volume
Issue
ISSN
21
1
1070-9932
Citations 
PageRank 
References 
5
0.84
0
Authors
3
Name
Order
Citations
PageRank
Fabio Bonsignorio1225.60
Angel P. Del Pobil2667106.45
Elena Messina318723.36