Title
Reward-based learning of a redundant task.
Abstract
Motor skill learning has different components. When we acquire a new motor skill we have both to learn a reliable action-value map to select a highly rewarded action (task model) and to develop an internal representation of the novel dynamics of the task environment, in order to execute properly the action previously selected (internal model). Here we focus on a 'pure' motor skill learning task, in which adaptation to a novel dynamical environment is negligible and the problem is reduced to the acquisition of an action-value map, only based on knowledge of results. Subjects performed point-to-point movement, in which start and target positions were fixed and visible, but the score provided at the end of the movement depended on the distance of the trajectory from a hidden viapoint. Subjects did not have clues on the correct movement other than the score value. The task is highly redundant, as infinite trajectories are compatible with the maximum score. Our aim was to capture the strategies subjects use in the exploration of the task space and in the exploitation of the task redundancy during learning. The main findings were that (i) subjects did not converge to a unique solution; rather, their final trajectories are determined by subject-specific history of exploration. (ii) with learning, subjects reduced the trajectory's overall variability, but the point of minimum variability gradually shifted toward the portion of the trajectory closer to the hidden via-point.
Year
DOI
Venue
2013
10.1109/ICORR.2013.6650386
ICORR
Keywords
Field
DocType
motor skill learning,task redundancy,redundant task,neurophysiology,reward-based learning,patient rehabilitation,infinite trajectory,action-value map,point-to-point movement,correlation,redundancy,trajectory,space exploration
Neurophysiology,Motor skill,Computer science,Redundancy (engineering),Artificial intelligence,Challenge point framework,Internal model,Knowledge of results,Machine learning,Trajectory
Conference
Volume
ISSN
ISBN
2013
1945-7901
978-1-4673-6022-7
Citations 
PageRank 
References 
0
0.34
1
Authors
3
Name
Order
Citations
PageRank
Irene Tamagnone100.68
Maura Casadio22210.03
Vittorio Sanguineti36812.86