Title
Affective state recognition in married couples' interactions using PCA-based vocal entrainment measures with multiple instance learning
Abstract
Recently there has been an increase in efforts in Behavioral Signal Processing (BSP), that aims to bring quantitative analysis using signal processing techniques in the domain of observational coding. Currently observational coding in fields such as psychology is based on subjective expert coding of abstract human interaction dynamics. In this work, we use a Multiple Instance Learning (MIL) framework, a saliencybased prediction model, with a signal-driven vocal entrainment measure as the feature to predict the affective state of a spouse in problem solving interactions. We generate 18 MIL classifiers to capture the variablelength saliency of vocal entrainment, and a cross-validation scheme with maximum accuracy and mutual information as the metric to select the best performing classifier for each testing couple. This method obtains a recognition accuracy of 53.93%, a 2.14% (4.13% relative) improvement over baseline model using Support Vector Machine. Furthermore, this MIL-based framework has potential for identifying meaningful regions of interest for further detailed analysis of married couples interactions.
Year
DOI
Venue
2011
10.1007/978-3-642-24571-8_4
ACII (2)
Keywords
Field
DocType
detailed analysis,maximum accuracy,observational coding,pca-based vocal entrainment measure,saliencybased prediction model,recognition accuracy,quantitative analysis,affective state recognition,married couple,multiple instance learning,signal-driven vocal entrainment measure,mil-based framework,mil classifier,baseline model
Signal processing,Observational study,Communication,Salience (neuroscience),Computer science,Coding (social sciences),Entrainment (chronobiology),Artificial intelligence,Classifier (linguistics),Support vector machine,Speech recognition,Mutual information,Machine learning
Conference
Volume
ISSN
Citations 
6975
0302-9743
7
PageRank 
References 
Authors
1.01
6
6
Name
Order
Citations
PageRank
Chi-Chun Lee165449.41
Athanasios Katsamanis230122.71
Matthew P. Black319213.67
Brian R. Baucom415216.36
Georgiou Panayiotis542855.79
Narayanan Shrikanth65558439.23