Name
Title | ||
|---|---|---|
Dynamic Representation Learning for Video Action Recognition Using Temporal Residual Networks |
Abstract | ||
|---|---|---|
Recent progresses in video action recognition are driven by the great success of convolutional neural networks (ConvNets). Many researches have investigated modeling spatiotemporal architecture with ConvNets to take full advantage of video information. However, the quality of video representations that serve as the network inputs, is often insufficient due to significant background motion. In this paper, we propose an Improved Dynamic Image (IDI) to describe videos by applying salient object detection and rank pooling on sequence of still images. Saliency detection aims to segment objects of interest which can be viewed as image-level background motion removal, while rank pooling is used to construct dynamic images as input to ConvNets. We also present a temporal Residual Network (ResNet) architecture which directly operates on multiple IDIs for long-term video representations learning. Experiments on two standard action recognition benchmarks demonstrate that our method achieves state-of-the-art performance without combining video-level representations (e.g. dense optical flow) as well as hand-designed features (e.g. improved dense trajectories). |
Year | DOI | Venue |
|---|---|---|
2018 | 10.1109/SmartWorld.2018.00089 | 2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI) |
Keywords | Field | DocType |
action recognition,saliency detection,improved dynamic image,temporal ResNets | Residual,Architecture,Pattern recognition,Salience (neuroscience),Convolutional neural network,Computer science,Pooling,Action recognition,Artificial intelligence,Optical flow,Feature learning,Distributed computing | Conference |
ISBN | Citations | PageRank |
978-1-5386-9381-0 | 0 | 0.34 |
References | Authors | |
8 | 5 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Yongqiang Kong | 1 | 4 | 1.79 |
| Jianhui Huang | 2 | 81 | 14.20 |
| Shanshan Huang | 3 | 33 | 8.82 |
| Zhengang Wei | 4 | 3 | 1.09 |
| Shengke Wang | 5 | 1 | 1.70 |