Title
Inconsistency-Based Multi-Task Cooperative Learning for Emotion Recognition
Abstract
Emotion recognition is an important part of affective computing. Human emotions can be described categorically or dimensionally. Accurate machine learning models for emotion classification and estimation usually depend on a large amount of annotated data. However, label acquisition in emotion recognition is costly: obtaining the ground-truth labels of an emotional sample usually requires multiple annotators’ assessments, which is expensive and time-consuming. To reduce the labeling effort in multi-task emotions recognition, the paper proposes an inconsistency measure that can indicate the difference between the labels estimated from the feature space and the label distribution of labeled dataset. Using the inconsistency as an indicator of sample informativeness, we further propose an inconsistency-based multi-task cooperative learning framework that integrates multi-task active learning and self-training semi-supervised learning. Experiments in two multi-task emotion recognition scenarios, multi-dimensional emotion estimation and simultaneous emotion classification and estimation, were conducted under this framework. The results demonstrated that the proposed multi-task active learning framework outperformed several single-task and multi-task active learning approaches.
Year
DOI
Venue
2022
10.1109/TAFFC.2022.3197414
IEEE Transactions on Affective Computing
Keywords
DocType
Volume
Active learning,semi-supervised learning,multi-task learning,cooperative learning,emotion recognition
Journal
13
Issue
ISSN
Citations 
4
1949-3045
0
PageRank 
References 
Authors
0.34
17
7
Name
Order
Citations
PageRank
Yifan Xu142.07
Yuqi Cui242.12
Xue Jiang300.34
Yingjie Yin400.34
Jingting Ding500.34
Liang Li627714.18
Dongrui Wu7165893.01