Name
Title | ||
|---|---|---|
A Demonstration Of Stability-Plasticity Imbalance In Multi-Agent, Decomposition-Based Learning |
Abstract | ||
|---|---|---|
Layered learning is a machine learning paradigm used in conjunction with direct-policy search reinforcement learning methods to find high performance agent behaviors for complex tasks. At its core, layered learning is a decomposition-based paradigm that shares many characteristics with robot shaping, transfer learning, hierarchical decomposition, and incremental learning. Previous studies have provided evidence that layered learning has the ability to outperform standard monolithic methods of learning in many cases.The dilemma of balancing stability and plasticity is a common problem in machine learning that causes learning agents to compromise between retaining learned information to perform a task with new incoming information. Although existing work implies that there is a stability-plasticity imbalance that greatly limits layered learning agents' ability to learn optimally, no work explicitly verifies the existence of the imbalance or its causes. This work investigates the stability-plasticity imbalance and demonstrates that indeed, layered learning heavily favors plasticity, which can cause learned subtask proficiency to be lost when new tasks are learned. We conclude by identifying potential causes of the imbalance in layered learning and provide high level advice about how to mitigate the imbalance's negative effects. |
Year | DOI | Venue |
|---|---|---|
2015 | 10.1109/ICMLA.2015.106 | 2015 IEEE 14TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA) |
Keywords | Field | DocType |
Stability-Plasticity Dilemma, Layered Learning, Decomposition-based Reinforcement Learning | Robot learning,Stability (learning theory),Multi-task learning,Instance-based learning,Active learning (machine learning),Computer science,Unsupervised learning,Artificial intelligence,Machine learning,Proactive learning,Learning classifier system | Conference |
Citations | PageRank | References |
0 | 0.34 | 5 |
Authors | ||
2 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Sean Mondesire | 1 | 7 | 3.40 |
| R. Paul Wiegand | 2 | 212 | 20.47 |