Title
Automatic Discovery and Transfer of Task Hierarchies in Reinforcement Learning.
Abstract
Sequential decision tasks present many opportunities for the study of transfer learning. A principal one among them is the existence of multiple domains that share the same underlying causal structure for actions. We describe an approach that exploits this shared causal structure to discover a hierarchical task structure in a source domain, which in turn speeds up learning of task execution knowledge in a new target domain. Our approach is theoretically justified and compares favorably to manually designed task hierarchies in learning efficiency in the target domain. We demonstrate that causally motivated task hierarchies transfer more robustly than other kinds of detailed knowledge that depend on the idiosyncrasies of the source domain and are hence less transferable.
Year
DOI
Venue
2011
10.1609/aimag.v32i1.2342
AI MAGAZINE
DocType
Volume
Issue
Journal
32
SP1
ISSN
Citations 
PageRank 
0738-4602
5
0.44
References 
Authors
25
4
Name
Order
Citations
PageRank
Neville Mehta1845.90
Soumya Ray2948.89
Prasad Tadepalli31182152.65
Thomas G. Dietterich493361722.57