Title
Cloth and skin deformation with a triangle mesh based convolutional neural network
Abstract
ABSTRACTWe introduce a triangle mesh based convolutional neural network. The proposed network structure can be used for problems where input and/or output are defined on a manifold triangle mesh with or without boundary. We demonstrate its applications in cloth upsampling, adding back details to Principal Component Analysis (PCA) compressed cloth, regressing clothing deformation from character poses, and regressing hand skin deformation from bones' joint angles. The data used for training in this work are generated from high resolution extended position based dynamics (XPBD) physics simulations with small time steps and high iteration counts and from an offline FEM simulator, but it can come from other sources. The inference time of our prototype implementation, depending on the mesh resolution and the network size, can provide between 4 to 134 times faster than a GPU based simulator. The inference also only needs to be done for meshes currently visible by the camera.
Year
DOI
Venue
2020
10.1111/cgf.14107
SCA
Keywords
DocType
Volume
CCS Concepts, &#8226, Computing methodologies &#8594, Physical simulation, Neural networks
Journal
39
Issue
ISSN
Citations 
8
0167-7055
2
PageRank 
References 
Authors
0.36
0
5
Name
Order
Citations
PageRank
Nuttapong Chentanez167538.02
Miles Macklin224817.11
Matthias Muller32726122.09
Stefan Jeschke4164.75
Tae-Yong Kim550426.69