Title
Prediction of advertisement preference by fusing EEG response and sentiment analysis.
Abstract
This paper presents a novel approach to predict rating of video-advertisements based on a multimodal framework combining physiological analysis of the user and global sentiment-rating available on the internet. We have fused Electroencephalogram (EEG) waves of user and corresponding global textual comments of the video to understand the user’s preference more precisely. In our framework, the users were asked to watch the video-advertisement and simultaneously EEG signals were recorded. Valence scores were obtained using self-report for each video. A higher valence corresponds to intrinsic attractiveness of the user. Furthermore, the multimedia data that comprised of the comments posted by global viewers, were retrieved and processed using Natural Language Processing (NLP) technique for sentiment analysis. Textual contents from review comments were analyzed to obtain a score to understand sentiment nature of the video. A regression technique based on Random forest was used to predict the rating of an advertisement using EEG data. Finally, EEG based rating is combined with NLP-based sentiment score to improve the overall prediction. The study was carried out using 15 video clips of advertisements available online. Twenty five participants were involved in our study to analyze our proposed system. The results are encouraging and these suggest that the proposed multimodal approach can achieve lower RMSE in rating prediction as compared to the prediction using only EEG data.
Year
DOI
Venue
2017
10.1016/j.neunet.2017.01.013
Neural Networks
Keywords
Field
DocType
EEG signal analysis,Multimedia indexing and retrieval,Predictive modeling,Multimodal rating,Sentiment analysis
Regression,Advertising,Computer science,Sentiment analysis,Mean squared error,Artificial intelligence,Eeg data,Random forest,Eeg signal analysis,Machine learning,Electroencephalography,The Internet
Journal
Volume
Issue
ISSN
92
1
0893-6080
Citations 
PageRank 
References 
16
0.65
28
Authors
6
Name
Order
Citations
PageRank
Himaanshu Gauba1652.28
Pradeep Kumar211611.02
Partha Pratim Roy359777.02
Singh, P.4758.97
Debi Prosad Dogra522829.89
Balasubramanian Raman667970.23