Title
A new optimization algorithm for non-stationary time series prediction based on recurrent neural networks
Abstract
Deep neural network with recurrent structure was proposed in the recent years and has been applied to time series forecasting. Many optimization algorithms are developed under the assumption of invariant and stationary data distributions, which is invalid for the non-stationary data. A novel optimization algorithm for modeling non-stationary time series is proposed in this paper. A moving window and exponential decay weights are used in this algorithm to eliminate the effects of the history gradients. The regret bound of the new algorithm is analyzed to ensure the convergency of the calculation. Simulations are done on short-term power load data sets, which are typically non-stationary. The results are superior to the existing optimization algorithms.
Year
DOI
Venue
2020
10.1016/j.future.2019.09.018
Future Generation Computer Systems
Keywords
Field
DocType
Recursive neural network,Optimization method,Non-stationary data,Time series forecast,ADAptive Moment estimation
Time series,Data set,Regret,Computer science,Exponential decay,Algorithm,Recurrent neural network,Stationary process,Real-time computing,Invariant (mathematics),Artificial neural network
Journal
Volume
ISSN
Citations 
102
0167-739X
2
PageRank 
References 
Authors
0.42
0
3
Name
Order
Citations
PageRank
Yulai Zhang152.54
Yuchao Wang220.42
Guiming Luo36928.79