Title
Image emotion distribution learning based on enhanced fuzzy KNN algorithm with sparse learning
Abstract
With the trend of people expressing opinions and emotions via images online, increasing attention has been paid to affective analysis of visual content. Traditional image affective analysis mainly focuses on single-label classification, but an image usually evokes multiple emotions. To this end, emotion distribution learning is proposed to describe emotions more explicitly. However, most current studies ignore the ambiguity included in emotions and the elusive correlations with complex visual features. Considering that emotions evoked by images are delivered through various visual features, and each feature in the image may have multiple emotion attributes, this paper develops a novel model that extracts multiple features and proposes an enhanced fuzzy k-nearest neighbor (EFKNN) to calculate the fuzzy emotional memberships. Specifically, the multiple visual features are converted into fuzzy emotional memberships of each feature belonging to emotion classes, which can be regarded as an intermediate representation to bridge the affective gap. Then, the fuzzy emotional memberships are fed into a fully connected neural network to learn the relationships between the fuzzy memberships and image emotion distributions. To obtain the fuzzy memberships of test images, a novel sparse learning method is introduced by learning the combination coefficients of test images and training images. Extensive experimental results on several datasets verify the superiority of our proposed approach for emotion distribution learning of images.
Year
DOI
Venue
2021
10.3233/JIFS-210251
JOURNAL OF INTELLIGENT & FUZZY SYSTEMS
Keywords
DocType
Volume
Image emotion recognition, emotion distribution learning, fuzzy emotional membership, sparse learning
Journal
41
Issue
ISSN
Citations 
6
1064-1246
0
PageRank 
References 
Authors
0.34
0
5
Name
Order
Citations
PageRank
Yunwen Zhu112.12
Wenjun Zhang200.34
Meixian Zhang300.34
Ke Zhang401.01
Yonghua Zhu501.35