Title
Combining attention-based bidirectional gated recurrent neural network and two-dimensional convolutional neural network for document-level sentiment classification.
Abstract
Neural networks lately have achieved a great success on sentiment classification due to their ability of feature extraction. However, it remains as an enormous challenge to model long texts in document-level sentiment classification as well as to explore semantics between sentences and dependencies between features. Moreover, most existing methods can hardly differentiate the importance of different contents when constructing a document representation. To tackle these problems, we propose a novel neural network model: AttDR-2DCNN, which mainly consists of two parts. The first part utilizes a two-layer compositional bidirectional Gated Recurrent Unit (GRU) to obtain the compositional semantics of the document, where the first layer learns the feature vector of the sentence, and the second layer learns the document matrix representation consisting of two dimensions of the time-step dimension and feature dimension, from the sentence vectors. The second part applies a two-dimensional convolution operation and two-dimensional max pooling to capture more dependencies between sentences features. We further utilize different types of attention mechanism in these two parts to distinguish the importance of words, sentences and features in the document. Experiments are conducted on four publicly available document-level review datasets and the result shows that the proposed model outperforms some existing models.
Year
DOI
Venue
2020
10.1016/j.neucom.2019.09.012
Neurocomputing
Keywords
Field
DocType
Sentiment classification,Attention network,2DCNN,Bidirectional GRU
Feature vector,Pattern recognition,Convolutional neural network,Recurrent neural network,Feature extraction,Artificial intelligence,Artificial neural network,Sentence,Semantics,Mathematics,Feature Dimension
Journal
Volume
ISSN
Citations 
371
0925-2312
4
PageRank 
References 
Authors
0.38
0
4
Name
Order
Citations
PageRank
Fagui Liu1236.06
Jingzhong Zheng240.38
Lailei Zheng340.38
Cheng Chen440.38