Name
Abstract | ||
|---|---|---|
We propose a novel approach to segment hand regions in egocentric video that requires no manual labeling of training samples. The user wearing a head-mounted camera is prompted to perform a simple gesture during an initial calibration step. A combination of color and motion analysis that exploits knowledge of the expected gesture is applied on the calibration video frames to automatically label hand pixels in an unsupervised fashion. The hand pixels identified in this manner are used to train a statistical-model-based hand detector. Superpixel region growing is used to perform segmentation refinement and improve robustness to noise. Experiments show that our hand detection technique based on the proposed on-the-fly training approach significantly outperforms state-of-the-art techniques with respect to accuracy and robustness on a variety of challenging videos. This is due primarily to the fact that training samples are personalized to a specific user and environmental conditions. We also demonstrate the utility of our hand detection technique to inform an adaptive video sampling strategy that improves both computational speed and accuracy of egocentric action recognition algorithms. Finally, we offer an egocentric video dataset of an insulin self-injection procedure with action labels and hand masks that can serve towards future research on both hand detection and egocentric action recognition. |
Year | DOI | Venue |
|---|---|---|
2015 | 10.1109/CVPRW.2015.7301344 | 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) |
Keywords | Field | DocType |
on-the-fly hand detection training,egocentric action recognition algorithm,hand region segmentation,egocentric video,head-mounted camera,motion analysis,color analysis,statistical-model-based hand detector,hand detection technique,adaptive video sampling strategy,insulin self-injection procedure,unsupervised fashion,superpixel region growing | Computer vision,Pattern recognition,Segmentation,Computer science,Gesture,Robustness (computer science),Feature extraction,Pixel,Artificial intelligence,Region growing,Motion analysis,Detector | Conference |
Volume | Issue | ISSN |
2015 | 1 | 2160-7508 |
Citations | PageRank | References |
6 | 0.41 | 43 |
Authors | ||
5 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Jayant Kumar | 1 | 173 | 11.11 |
| Qun Li | 2 | 81 | 6.81 |
| survi kyal | 3 | 26 | 2.62 |
| Edgar A. Bernal | 4 | 58 | 10.32 |
| Raja Bala | 5 | 99 | 17.72 |