Title: Local-constraint transformer network for stock movement prediction

Authors: Jincheng Hu

Addresses: School of Information Management and Engineering, Shanghai University of Finance and Economics, Shanghai, 200433, China; School of Information Management, Shanghai Lixin University of Accounting and Finance, Shanghai, 201209, China

Abstract: Stock movement prediction is to predict the future movements of stocks for investment, which is challenging both for research and industry. Typically, stock movement is predicted based on financial news. However, existing prediction methods based on financial news directly utilise models for natural language processing such as recurrent neural networks and transformer, which are still incapable of effectively processing the key local information in financial news. To address this issue, local-constraint transformer network (LTN) is proposed in this paper for stock movement prediction. LTN leverages transformer network with local-constraint to encode the financial news, which can increase the attention weights of key local information. Moreover, since there are more difficult samples in financial news which are hard to be learnt, this paper further proposes a difficult-sample-balance loss function to train the network. This paper also researches the combination of financial news and stock price data for prediction. Experiments demonstrate that the proposed model outperforms several powerful existing methods on the datasets collected, and the stock price data can assist to improve the prediction.

Keywords: stock movement prediction; short-term dependence; transformer; difficult sample.

DOI: 10.1504/IJCSE.2021.117030

International Journal of Computational Science and Engineering, 2021 Vol.24 No.4, pp.429 - 437

Received: 29 Dec 2020
Accepted: 11 Jan 2021
Published online: 12 Aug 2021 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article