Title
Two parameter update schemes for recurrent reinforcement learning
Abstract
Recurrent reinforcement learning (RRL) is a machine learning algorithm which has been proposed by researchers for constructing financial trading platforms. When an analysis of RRL trading performance is conducted using low frequency financial data (e.g. daily data), the weakening autocorrelation in price changes may lead to a decrease in trading profits as compared to its applications in high frequency trading. There therefore is a need to improve RRL for the purposes of daily equity trading. This paper presents two parameter update schemes (the `average elitist' and the `multiple elitist') for RRL. The purpose of the first scheme is to improve out-of-sample performance of RRL-type trading systems. The second scheme aims to exploit serial dependence in stock returns to improve trading performance, when traders deal with highly correlated stocks. Profitability and stability of the trading system are examined by using four groups of S&P stocks for the period January 2009 to December 2012. It is found that the Sharpe ratios of the stocks increase after we use the two parameter update schemes in the RRL trading system.
Year
DOI
Venue
2014
10.1109/CEC.2014.6900330
IEEE Congress on Evolutionary Computation
Keywords
Field
DocType
low frequency financial data,recurrent reinforcement learning,price change,high frequency trading,sharpe ratio,learning (artificial intelligence),s&p stocks,profitability,financial data processing,multiple elitist scheme,stock markets,financial trading platforms,parameter update scheme,daily equity trading,rrl algorithm,rrl trading performance,stock returns,rrl-type trading systems,trading profits,average elitist scheme,learning artificial intelligence,correlation,economics,algorithm design and analysis
Trading strategy,Mathematical optimization,High-frequency trading,Computer science,Profitability index,Sharpe ratio,Equity (finance),Stock (geology),Algorithmic trading,Reinforcement learning
Conference
Citations 
PageRank 
References 
1
0.36
5
Authors
2
Name
Order
Citations
PageRank
Jin Zhang130.76
Dietmar Maringer215611.35