Title
Crossmodal Attentive Skill Learner
Abstract
This paper introduces the Crossmodal Attentive Skill Learner (CASL), integrated with the recently-introduced Asynchronous Advantage Option-Critic (A2OC) architecture [15] to enable hierarchical reinforcement learning across multiple sensory inputs. We provide concrete examples where the approach not only improves performance in a single task, but accelerates transfer to new tasks. We demonstrate the attention mechanism anticipates and identifies useful latent features, while filtering irrelevant sensor modalities during execution. We modify the Arcade Learning Environment [7] to support audio queries, and conduct evaluations of crossmodal learning in the Atari 2600 games H.E.R.O. and Amidar. Finally, building on the recent work of Babaeizadeh et al. [4], we open-source a fast hybrid CPU-GPU implementation of CASL.(1)
Year
DOI
Venue
2018
10.5555/3237383.3237410
PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS (AAMAS' 18)
Keywords
DocType
Volume
hierarchical learning, options, reinforcement learning, attention
Conference
abs/1711.10314
Citations 
PageRank 
References 
0
0.34
28
Authors
4
Name
Order
Citations
PageRank
Shayegan Omidshafiei16010.34
dong ki kim2185.65
Jason Pazis31046.97
Jonathan How41759185.09