Title
Intelligent Carpet: Inferring 3D Human Pose from Tactile Signals
Abstract
Daily human activities, e.g., locomotion, exercises, and resting, are heavily guided by the tactile interactions between the human and the ground. In this work, leveraging such tactile interactions, we propose a 3D human pose estimation approach using the pressure maps recorded by a tactile carpet as input. We build a low-cost, high-density, large-scale intelligent carpet, which enables the real-time recordings of human-floor tactile interactions in a seamless manner. We collect a synchronized tactile and visual dataset on various human activities. Employing a state-ofthe-art camera-based pose estimation model as supervision, we design and implement a deep neural network model to infer 3D human poses using only the tactile information. Our pipeline can be further scaled up to multi-person pose estimation. We evaluate our system and demonstrate its potential applications in diverse fields.
Year
DOI
Venue
2021
10.1109/CVPR46437.2021.01110
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021
DocType
ISSN
Citations 
Conference
1063-6919
1
PageRank 
References 
Authors
0.35
27
8
Name
Order
Citations
PageRank
Yiyue Luo111.70
Yunzhu Li2607.93
Michael Foshey383.20
Wan Shou410.69
Pratyusha Sharma510.35
Tomas Palacios612.71
Antonio Torralba714607956.27
Wojciech Matusik84771254.42