Title
Fuzzy Kanerva-based function approximation for reinforcement learning
Abstract
Radial Basis Functions and Kanerva Coding can give poor performance when applied to large-scale multi-agent systems. In this paper, we attempt to solve a collection of predator-prey pursuit instances and argue that the poor performance is caused by frequent prototype collisions. We show that dynamic prototype allocation and adaptation can give better results by reducing these collisions. We then describe our novel approach, fuzzy Kanerva-based function approximation, that uses a fine-grained fuzzy membership grade to describe a state-action pair's adjacency with respect to each prototype. This approach completely eliminates prototype collisions. We conclude that adaptive fuzzy Kanerva Coding can significantly improve a reinforcement learner's ability to solve large-scale multi-agent problems.
Year
DOI
Venue
2009
10.5555/1558109.1558240
AAMAS (2)
Keywords
Field
DocType
poor performance,large-scale multi-agent problem,prototype collision,adaptive fuzzy kanerva coding,frequent prototype collision,fine-grained fuzzy membership grade,fuzzy kanerva-based function approximation,kanerva coding,large-scale multi-agent system,dynamic prototype allocation,reinforcement learning,function approximation,fuzzy logic
Adjacency list,Radial basis function,Function approximation,Computer science,Fuzzy logic,Coding (social sciences),Artificial intelligence,Reinforcement,Machine learning,Reinforcement learning
Conference
Citations 
PageRank 
References 
7
0.53
4
Authors
2
Name
Order
Citations
PageRank
Cheng Wu1575.41
Waleed Meleis215718.29