Title
Csnn: Contextual Sentiment Neural Network
Abstract
Although deep neural networks are excellent for text sentiment analysis, their applications in real-world practice are occasionally limited owing to their black-box property. In response, we propose a novel neural network model called contextual sentiment neural network (CSNN) model that can explain the process of its sentiment analysis prediction in a way that humans find natural and agreeable. The CSNN has the following interpretable layers: the word-level original sentiment layer, word-level sentiment shift layer, word-level local contextual sentiment layer, word-level global importance layer, and word-level global contextual sentiment layer. Because of these layers, this network can explain the process of its document-level sentiment analysis results in a human-like way using these layers. Realizing the interpretability of each layer in the CSNN is a crucial problem in the development of this CSNN because the general back-propagation method cannot realize such interpretability. To realize this interpretability, we propose a novel learning strategy called initialization propagation (IP) learning. Using real textual datasets, we experimentally demonstrate that the proposed IP learning is effective for improving the interpretability of each layer in CSNN. We then experimentally demonstrate that both the predictability and explanation ability of the CSNN are high.
Year
DOI
Venue
2019
10.1109/ICDM.2019.00135
2019 19TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2019)
Keywords
Field
DocType
Interpretable Neural Networks, Text-mining, Support System
Interpretability,Predictability,Text mining,Computer science,Support system,Sentiment analysis,Artificial intelligence,Initialization,Artificial neural network,Deep neural networks,Machine learning
Conference
ISSN
Citations 
PageRank 
1550-4786
0
0.34
References 
Authors
0
5
Name
Order
Citations
PageRank
Tomoki Ito111.72
Kota Tsubouchi28126.58
Hiroki Sakaji33017.97
Kiyoshi Izumi412737.12
Tatsuo Yamashita542.51