Title
A discourse-aware neural network-based text model for document-level text classification
Abstract
AbstractCapturing semantics scattered across entire text is one of the important issues for Natural Language Processing NLP tasks. It would be particularly critical with long text embodying a flow of themes. This article proposes a new text modelling method that can handle thematic flows of text with Deep Neural Networks DNNs in such a way that discourse information and distributed representations of text are incorporate. Unlike previous DNN-based document models, the proposed model enables discourse-aware analysis of text and composition of sentence-level distributed representations guided by the discourse structure. More specifically, our method identifies Elementary Discourse Units EDUs and their discourse relations in a given document by applying Rhetorical Structure Theory RST-based discourse analysis. The result is fed into a tree-structured neural network that reflects the discourse information including the structure of the document and the discourse roles and relation types. We evaluate the document model for two document-level text classification tasks, sentiment analysis and sarcasm detection, with comparisons against the reference systems that also utilise discourse information. In addition, we conduct additional experiments to evaluate the impact of neural network types and adopted discourse factors on modelling documents vis-à-vis the two classification tasks. Furthermore, we investigate the effects of various learning methods, input units on the quality of the proposed discourse-aware document model.
Year
DOI
Venue
2018
10.1177/0165551517743644
Periodicals
Keywords
Field
DocType
Deep learning, discourse analysis, neural network, sarcasm detection, sentiment analysis, text classification, text model
Rhetorical Structure Theory,Information retrieval,Computer science,Sentiment analysis,Discourse analysis,Artificial intelligence,Deep learning,Artificial neural network,Semantics,Deep neural networks,Discourse structure
Journal
Volume
Issue
ISSN
44
6
0165-5515
Citations 
PageRank 
References 
1
0.41
6
Authors
3
Name
Order
Citations
PageRank
Kangwook Lee111715.76
Sanggyu Han210.41
Sung-hyon Myaeng380289.18