Paper Info
Title
mmMesh: towards 3D real-time dynamic human mesh construction using millimeter-wave
Abstract
ABSTRACTIn this paper, we present mmMesh, the first real-time 3D human mesh estimation system using commercial portable millimeter-wave devices. mmMesh is built upon a novel deep learning framework that can dynamically locate the moving subject and capture his/her body shape and pose by analyzing the 3D point cloud generated from the mmWave signals that bounce off the human body. The proposed deep learning framework addresses a series of challenges. First, it encodes a 3D human body model, which enables mmMesh to estimate complex and realistic-looking 3D human meshes from sparse point clouds. Second, it can accurately align the 3D points with their corresponding body segments despite the influence of ambient points as well as the error-prone nature and the multi-path effect of the RF signals. Third, the proposed model can infer missing body parts from the information of the previous frames. Our evaluation results on a commercial mmWave sensing testbed show that our mmMesh system can accurately localize the vertices on the human mesh with an average error of 2.47 cm. The superior experimental results demonstrate the effectiveness of our proposed human mesh construction system.
Year
DOI
Venue
2021
10.1145/3458864.3467679
Mobile Systems, Applications, and Services
DocType
Citations 
PageRank 
Conference
2
0.37
References 
Authors
0
7
Name
Order
Citations
PageRank
Hongfei Xue1442.81
Yan Ju220.37
Chenglin Miao3917.44
Yijiang Wang420.37
Shiyang Wang570.81
Aidong Zhang62970405.63
lu su7111866.61