Name
Abstract | ||
|---|---|---|
We exploit textual information for recognizing human-human interaction activities in YouTube videos. YouTube videos are generally accompanied by various types of textual information, such as title, description, and tags. In particular, since some of the tags describe the visual content of the video, making good use of tags can aid activity recognition in the video. The proposed method uses two-fold information for activity recognition: (i) visual information: correlations among activities, human poses, configurations of human body parts, and image features extracted from visual content and (ii) textual information: correlations with activities extracted from tags. For tag analysis we discover a set of relevant tags and extract the meaningful words. Correlations between words and activities are learned from expanded tags obtained from tags of related videos. We develop a model that jointly captures two-fold information for activity recognition. We consider the model as a structured learning task with latent variables, and estimate the parameters of the model by using a non-convex minimization procedure. The proposed approach is evaluated using a dataset that consists of highly challenging real world videos and their assigned tags collected from YouTube. Experimental results demonstrate that by exploiting the visual and textual information in a structured framework, the proposed method can significantly improve the activity recognition results. |
Year | DOI | Venue |
|---|---|---|
2013 | 10.1016/j.patrec.2012.10.022 | Pattern Recognition Letters |
Keywords | Field | DocType |
human-human interaction activity,two-fold information,captures two-fold information,visual content,textual information,activity recognition result,visual information,activity recognition,youtube video | Activity recognition,Information retrieval,Textual information,Computer science,Feature (computer vision),Structured prediction,Exploit,Human interaction | Journal |
Volume | Issue | ISSN |
34 | 15 | 0167-8655 |
Citations | PageRank | References |
1 | 0.36 | 25 |
Authors | ||
3 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Sunyoung Cho | 1 | 98 | 10.58 |
| Sooyeong Kwak | 2 | 39 | 5.65 |
| Hyeran Byun | 3 | 505 | 65.97 |