Title
A large-scale behavior corpus including multi-angle video data for observing infants' long-term developmental processes
Abstract
We have developed a method for multimodal observation of infant development. In order to analyze development of problem solving skills by observing scenes of task achievement or communication with others, we have introduced a method for extracting detailed behavioral features expressed by gestures or eyes. We have realized an environment for recording behavior of the same infants continuously as multi-angle video. The environment has evolved into a practical infrastructure through the following four steps; (1) Establish an infant school and study the camera arrangement. (2) Obtain participants in the school who agree with the project purpose and start to hold regular classes. (3) Begin to construct a multimodal infant behavior corpus with considering observation methods. (4) Practice development process analyses using the corpus. We have constructed a support tool for observing a huge amount of video data which increases with age. The system has contributed to enrich the corpus with annotations from multimodal viewpoints about infant development. With a focus on the demonstrative expression as a fundamental human behavior, we have extracted 240 scenes from the video during 10 months and observed them. The analysis results have revealed interesting findings about the developmental changes in infants' gestures and eyes, and indicated the effectiveness of the proposed observation method.
Year
DOI
Venue
2007
10.1145/1322192.1322226
ICMI
Keywords
Field
DocType
multimodal infant behavior corpus,multimodal observation,large-scale behavior corpus,multi-angle video data,infant school,long-term developmental process,practice development process,multi-angle video,proposed observation method,fundamental human behavior,infant development,multimodal viewpoint,observation method,human behavior,development process
Computer vision,Viewpoints,Computer science,Gesture,Demonstrative,Human–computer interaction,Artificial intelligence
Conference
Citations 
PageRank 
References 
2
0.72
1
Authors
5
Name
Order
Citations
PageRank
Shinya Kiriyama187.28
Goh Yamamoto220.72
Naofumi Otani331.49
Shogo Ishikawa423.09
Yoichi Takebayashi54413.40