Name
Title | ||
|---|---|---|
Modelling coordination of learning systems: a reservoir systems approach to dopamine modulated pavlovian conditioning |
Abstract | ||
|---|---|---|
This paper presents a biologically constrained reward prediction model capable of learning cue-outcome associations involving temporally distant stimuli without using the commonly used temporal difference model. The model incorporates a novel use of an adapted echo state network to substitute the biologically implausible delay chains usually used, in relation to dopamine phenomena, for tackling temporally structured stimuli. Moreover, the model is based on a novel algorithm which successfully coordinates two sub systems: one providing Pavlovian conditioning, one providing timely inhibition of dopamine responses to salient anticipated stimuli. The model is validated against the typical profile of phasic dopamine in first and second order Pavlovian conditioning. The model is relevant not only to explaining the mechanisms underlying the biological regulation of dopamine signals, but also for applications in autonomous robotics involving reinforcement-based learning. |
Year | DOI | Venue |
|---|---|---|
2009 | 10.1007/978-3-642-21283-3_51 | ECAL (1) |
Keywords | Field | DocType |
phasic dopamine,pavlovian conditioning,reward prediction model,novel use,reservoir system,dopamine signal,temporal difference model,dopamine response,biologically implausible delay chain,novel algorithm,order pavlovian conditioning,modelling coordination,dopamine,reinforcement learning | Temporal difference learning,Computer science,Artificial intelligence,Echo state network,Stimulus (physiology),PVLV,Reinforcement,Biological regulation,Classical conditioning,Reinforcement learning | Conference |
Citations | PageRank | References |
5 | 0.51 | 6 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Robert Lowe | 1 | 111 | 12.22 |
| Francesco Mannella | 2 | 25 | 4.33 |
| Tom Ziemke | 3 | 681 | 67.03 |
| Gianluca Baldassarre | 4 | 518 | 51.34 |