Title
Articulation constrained learning with application to speech emotion recognition
Abstract
Speech emotion recognition methods combining articulatory information with acoustic features have been previously shown to improve recognition performance. Collection of articulatory data on a large scale may not be feasible in many scenarios, thus restricting the scope and applicability of such methods. In this paper, a discriminative learning method for emotion recognition using both articulatory and acoustic information is proposed. A traditional ℓ1-regularized logistic regression cost function is extended to include additional constraints that enforce the model to reconstruct articulatory data. This leads to sparse and interpretable representations jointly optimized for both tasks simultaneously. Furthermore, the model only requires articulatory features during training; only speech features are required for inference on out-of-sample data. Experiments are conducted to evaluate emotion recognition performance over vowels /AA/, /AE/, /IY/, /UW/ and complete utterances. Incorporating articulatory information is shown to significantly improve the performance for valence-based classification. Results obtained for within-corpus and cross-corpus categorical emotion recognition indicate that the proposed method is more effective at distinguishing happiness from other emotions.
Year
DOI
Venue
2019
10.1186/s13636-019-0157-9
EURASIP Journal on Audio, Speech, and Music Processing
Keywords
DocType
Volume
Emotion recognition, Articulation, Constrained optimization, Cross-corpus
Journal
2019
Issue
ISSN
Citations 
1
1687-4722
0
PageRank 
References 
Authors
0.34
0
5
Name
Order
Citations
PageRank
Mohit Shah1273.11
Ming Tu200.34
Visar Berisha37622.38
Chaitali Chakrabarti41978184.17
Andreas S. Spanias552887.90