Title
User independent, multi-modal spotting of subtle arm actions with minimal training data
Abstract
We address a specific, particularly difficult class of activity recognition problems defined by (1) subtle, and hardly discriminative hand motions such as a short press or pull, (2) large, ill defined NULL class (any other hand motion a person may express during normal life), and (3) difficulty of collecting sufficient training data, that generalizes well from one to multiple users. In essence we intend to spot activities such as opening a cupboard, pressing a button, or taking an object from a shelve in a large data stream that contains typical every day activity. We focus on body-worn sensors without instrumenting objects, we exploit available infrastructure information, and we perform a one-to-many-users training scheme for minimal training effort. We demonstrate that a state of the art motion sensors based approach performs poorly under such conditions (Equal Error Rate of 18% in our experiments). We present and evaluate a new multi modal system based on a combination of indoor location with a wrist mounted proximity sensor, camera and inertial sensor that raises the EER to 79%.
Year
DOI
Venue
2013
10.1109/PerComW.2013.6529448
Pervasive Computing and Communications Workshops
Keywords
Field
DocType
cameras,image motion analysis,image recognition,image sensors,activity recognition problem,body-worn sensor,camera,ill defined null class,inertial sensor,motion sensor,multimodal spotting,one-to-many-users training scheme,subtle arm action,wrist mounted proximity sensor,ADL,Activity Spotting,Hand Mounted Camera,Multi-Modal Sensing,Wearable Sensors
Computer vision,Activity recognition,Proximity sensor,Image sensor,Computer science,Data stream,Word error rate,Artificial intelligence,Discriminative model,Spotting,Modal
Conference
ISSN
ISBN
Citations 
2474-2503
978-1-4673-5076-1
0
PageRank 
References 
Authors
0.34
14
4
Name
Order
Citations
PageRank
Gerald Bauer1664.62
Ulf Blanke269936.03
Paul Lukowicz33287376.79
Bernt Schiele412901971.29