Title
Learning To Trade In Financial Time Series Using High-Frequency Through Wavelet Transformation And Deep Reinforcement Learning
Abstract
Deep learning-based financial approaches have received attention from both investors and researchers. This study demonstrates how to optimize portfolios, asset allocation, and trading systems based on deep reinforcement learning using three frameworks. In the proposed deep learning structure, the input data are first decomposed through wavelet transformation (WT) to remove noise from stock price time-series data. Then, only the mother wavelet (high-frequency) data are used as input. Second, reinforcement learning is performed using the high-frequency data. The reinforcement learning network employs long short-term memory (LSTM). Actions are determined by the LSTM network or randomly. Third, it learns the optimal investment trading system using the actions of a given transaction and appropriate rewards. The structure of the optimal investment trading system obtained by the proposed deep reinforcement learning structure improves trading performance without requiring the construction of a predictive model. To investigate the performance of the proposed structure, we applied the S&P500, DJI, and KOSPI200 indices to the proposed structure (HW_LSTM_RL) and other reinforcement learning structures for comparison. We evaluated the difference in Sharpe ratio for various test periods (one to three years) and for different rewards. Using the decomposed high-frequency data as input, a portfolio of investment transactions was improved for highly volatile markets. In deep reinforcement learning, we found that network composition and appropriate rewards have significant influence on learning transactions in financial time-series data. Thus, the proposed HW_LSTM_RL structure demonstrates the importance of input data composition, learning network settings, and rewards.
Year
DOI
Venue
2021
10.1007/s10489-021-02218-4
APPLIED INTELLIGENCE
Keywords
DocType
Volume
Deep reinforcement learning (Deep RL), Wavelet transforms, LSTM, Wavelet deep LSTM Q&#8722, network, High frequency, Trading system, Portfolio optimization, Sharpe Ratio
Journal
51
Issue
ISSN
Citations 
8
0924-669X
0
PageRank 
References 
Authors
0.34
0
3
Name
Order
Citations
PageRank
Jimin Lee100.34
Hayeong Koh200.34
Hi Jun Choe353.52