Title | ||
---|---|---|
User independent, multi-modal spotting of subtle arm actions with minimal training data |
Abstract | ||
---|---|---|
We address a specific, particularly difficult class of activity recognition problems defined by (1) subtle, and hardly discriminative hand motions such as a short press or pull, (2) large, ill defined NULL class (any other hand motion a person may express during normal life), and (3) difficulty of collecting sufficient training data, that generalizes well from one to multiple users. In essence we intend to spot activities such as opening a cupboard, pressing a button, or taking an object from a shelve in a large data stream that contains typical every day activity. We focus on body-worn sensors without instrumenting objects, we exploit available infrastructure information, and we perform a one-to-many-users training scheme for minimal training effort. We demonstrate that a state of the art motion sensors based approach performs poorly under such conditions (Equal Error Rate of 18% in our experiments). We present and evaluate a new multi modal system based on a combination of indoor location with a wrist mounted proximity sensor, camera and inertial sensor that raises the EER to 79%. |
Year | DOI | Venue |
---|---|---|
2013 | 10.1109/PerComW.2013.6529448 | Pervasive Computing and Communications Workshops |
Keywords | Field | DocType |
cameras,image motion analysis,image recognition,image sensors,activity recognition problem,body-worn sensor,camera,ill defined null class,inertial sensor,motion sensor,multimodal spotting,one-to-many-users training scheme,subtle arm action,wrist mounted proximity sensor,ADL,Activity Spotting,Hand Mounted Camera,Multi-Modal Sensing,Wearable Sensors | Computer vision,Activity recognition,Proximity sensor,Image sensor,Computer science,Data stream,Word error rate,Artificial intelligence,Discriminative model,Spotting,Modal | Conference |
ISSN | ISBN | Citations |
2474-2503 | 978-1-4673-5076-1 | 0 |
PageRank | References | Authors |
0.34 | 14 | 4 |
Name | Order | Citations | PageRank |
---|---|---|---|
Gerald Bauer | 1 | 66 | 4.62 |
Ulf Blanke | 2 | 699 | 36.03 |
Paul Lukowicz | 3 | 3287 | 376.79 |
Bernt Schiele | 4 | 12901 | 971.29 |