Name
Abstract | ||
|---|---|---|
We introduce a new problem domain for activity recognition: the analysis of children's social and communicative behaviors based on video and audio data. We specifically target interactions between children aged 1-2 years and an adult. Such interactions arise naturally in the diagnosis and treatment of developmental disorders such as autism. We introduce a new publicly-available dataset containing over 160 sessions of a 3-5 minute child-adult interaction. In each session, the adult examiner followed a semi-structured play interaction protocol which was designed to elicit a broad range of social behaviors. We identify the key technical challenges in analyzing these behaviors, and describe methods for decoding the interactions. We present experimental results that demonstrate the potential of the dataset to drive interesting research questions, and show preliminary results for multi-modal activity recognition. |
Year | DOI | Venue |
|---|---|---|
2013 | 10.1109/CVPR.2013.438 | CVPR |
Keywords | Field | DocType |
audio data,new publicly-available dataset,new problem domain,minute child-adult interaction,semi-structured play interaction protocol,multi-modal activity recognition,decoding children,social behavior,broad range,activity recognition,adult examiner,pediatrics,protocols,testing,decoding,social behaviors,autism,face,audio signal processing | Problem domain,Computer science,Interaction protocol,Human–computer interaction,Artificial intelligence,Audio signal processing,Autism,Social behavior,Activity recognition,Pattern recognition,Decoding methods,Multimedia,Patient treatment | Conference |
Volume | Issue | ISSN |
2013 | 1 | 1063-6919 |
Citations | PageRank | References |
21 | 1.11 | 18 |
Authors | ||
17 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| James M. Rehg | 1 | 5259 | 474.66 |
| Gregory D. Abowd | 2 | 11979 | 1503.13 |
| Agata Rozga | 3 | 31 | 1.92 |
| Mario Romero | 4 | 48 | 2.31 |
| Mark A. Clements | 5 | 486 | 64.32 |
| Stan Sclaroff | 6 | 5631 | 705.89 |
| Irfan A. Essa | 7 | 4876 | 580.85 |
| Opal Y. Ousley | 8 | 21 | 1.11 |
| Yin Li | 9 | 797 | 35.85 |
| Chanho Kim | 10 | 83 | 5.57 |
| Hrishikesh Rao | 11 | 35 | 2.17 |
| Jonathan C. Kim | 12 | 39 | 2.56 |
| Liliana Lo Presti | 13 | 223 | 20.67 |
| Jianming Zhang | 14 | 853 | 35.35 |
| Denis Lantsman | 15 | 21 | 1.11 |
| Jonathan Bidwell | 16 | 41 | 3.24 |
| Zhefan Ye | 17 | 101 | 4.79 |