Title
Learning to Reproduce Fluctuating Time Series by Inferring Their Time-Dependent Stochastic Properties: Application in Robot Learning Via Tutoring
Abstract
This study proposes a novel type of dynamic neural network model that can learn to extract stochastic or fluctuating structures hidden in time series data. The network learns to predict not only the mean of the next input state, but also its time-dependent variance. The training method is based on maximum likelihood estimation by using the gradient descent method and the likelihood function is expressed as a function of the estimated variance. Regarding the model evaluation, we present numerical experiments in which training data were generated in different ways utilizing Gaussian noise. Our analysis showed that the network can predict the time-dependent variance and the mean and it can also reproduce the target stochastic sequence data by utilizing the estimated variance. Furthermore, it was shown that a humanoid robot using the proposed network can learn to reproduce latent stochastic structures hidden in fluctuating tutoring trajectories. This learning scheme is essential for the acquisition of sensory-guided skilled behavior.
Year
DOI
Venue
2013
10.1109/TAMD.2013.2258019
Autonomous Mental Development, IEEE Transactions
Keywords
Field
DocType
Gaussian noise,gradient methods,humanoid robots,learning systems,maximum likelihood estimation,neurocontrollers,time series,Gaussian noise,dynamic neural network model,estimated variance function,fluctuating structures,fluctuating time series,fluctuating tutoring trajectories,gradient descent method,humanoid robot,learning scheme,likelihood function,maximum likelihood estimation,model evaluation,robot learning,sensory-guided skilled behavior,stochastic sequence data,stochastic structures,time series data,time-dependent stochastic properties,time-dependent variance,training method,Dynamical systems approach,humanoid robot,maximum likelihood estimation,recurrent neural network
Robot learning,Time series,Gradient descent,Likelihood function,Computer science,Recurrent neural network,Dynamical systems theory,Artificial intelligence,Gaussian noise,Machine learning,Humanoid robot
Journal
Volume
Issue
ISSN
5
4
1943-0604
Citations 
PageRank 
References 
22
1.46
16
Authors
4
Name
Order
Citations
PageRank
Murata, S.1221.46
Namikawa, J.2221.46
Arie, H.3261.92
Shigeki Sugano4689161.38