Title
Curious George: An attentive semantic robot
Abstract
State-of-the-art methods have recently achieved impressive performance for recognising the objects present in large databases of pre-collected images. There has been much less focus on building embodied systems that recognise objects present in the real world. This paper describes an intelligent system that attempts to perform robust object recognition in a realistic scenario, where a mobile robot moving through an environment must use the images collected from its camera directly to recognise objects. To perform successful recognition in this scenario, we have chosen a combination of techniques including a peripheral-foveal vision system, an attention system combining bottom-up visual saliency with structure from stereo, and a localisation and mapping technique. The result is a highly capable object recognition system that can be easily trained to locate the objects of interest in an environment, and subsequently build a spatial-semantic map of the region. This capability has been demonstrated during the Semantic Robot Vision Challenge, and is further illustrated with a demonstration of semantic mapping. We also empirically verify that the attention system outperforms an undirected approach even with a significantly lower number of foveations.
Year
DOI
Venue
2008
10.1016/j.robot.2008.03.008
Robotics and Autonomous Systems
Keywords
Field
DocType
Object recognition,Visual attention,Saliency,Semantic robot vision,Object permanence
Computer vision,Machine vision,Semantic mapping,Salience (neuroscience),Computer science,Embodied cognition,Artificial intelligence,Object permanence,Robot,Mobile robot,Cognitive neuroscience of visual object recognition
Journal
Volume
Issue
ISSN
56
6
Robotics and Autonomous Systems
Citations 
PageRank 
References 
96
3.15
19
Authors
9
Name
Order
Citations
PageRank
David Meger140332.90
Per-Erik Forssén239125.70
Kevin Lai31800121.10
Scott Helmer417611.49
Sancho McCann52007.28
Tristram Southey61547.61
Matthew Baumann71054.07
James J. Little82430269.59
D. G. Lowe9157181413.60