Title
ActiSight: Wearer Foreground Extraction Using a Practical RGB-Thermal Wearable
Abstract
Wearable cameras provide an informative view of wearer activities, context, and interactions. Video obtained from wearable cameras is useful for life-logging, human activity recognition, visual confirmation, and other tasks widely utilized in mobile computing today. Extracting foreground information related to the wearer and separating irrelevant background pixels is the fundamental operation underlying these tasks. However, current wearer foreground extraction methods that depend on image data alone are slow, energy-inefficient, and even inaccurate in some cases, making many tasks–like activity recognition–challenging to implement in the absence of significant computational resources. To fill this gap, we built ActiSight, a wearable RGB-Thermal video camera that uses thermal information to make wearer segmentation practical for body-worn video. Using ActiSight, we collected a total of 59 hours of video from 6 participants, capturing a wide variety of activities in a natural setting. We show that wearer foreground extracted with ActiSight achieves a high dice similarity score while significantly lowering execution time and energy cost when compared with an RGB-only approach.
Year
DOI
Venue
2022
10.1109/PerCom53586.2022.9762385
2022 IEEE International Conference on Pervasive Computing and Communications (PerCom)
Keywords
DocType
ISSN
Wearable cameras,in wild,thermal
Conference
2474-2503
ISBN
Citations 
PageRank 
978-1-6654-1644-3
0
0.34
References 
Authors
18
5
Name
Order
Citations
PageRank
Rawan Alharbi100.34
Sougata Sen200.34
Ada Ng300.34
Nabil Alshurafa413419.65
Josiah D. Hester513818.13