Title
Animating Your Life: Real-Time Video-to-Animation Translation
Abstract
We demonstrate a video-to-animation translator, which can transform real-world video into cartoon or ink-wash animation in real-time. When users upload a video or record what they are seeing with the phone, the video-to-animation translator renders the live streaming video with cartoon or ink-wash animation style while maintaining the original contents. We formulate this task as video-to-video translation problem in the absence of any paired training examples, since the manual labeling of such paired video-animation data is cost-expensive and even unrealistic in practice. Technically, an unified unpaired video-to-video translator is utilized to explore both appearance structure and temporal continuity in video synthesis. As such, not only the visual appearance in each frame but also motion between consecutive frames are ensured to be realistic and consistent for video translation. Based on these technologies, our demonstration can be conducted on any videos in the wild and supports live video-to-animation translation, which engages users with the animated artistic expression of their life.
Year
DOI
Venue
2019
10.1145/3343031.3350593
Proceedings of the 27th ACM International Conference on Multimedia
Keywords
Field
DocType
gans, unsupervised learning, video-to-video translation
Computer science,Animation,Multimedia
Conference
ISBN
Citations 
PageRank 
978-1-4503-6889-6
0
0.34
References 
Authors
0
5
Name
Order
Citations
PageRank
Yang Chen161.47
Yingwei Pan235723.66
Ting Yao384252.62
Xinmei Tian4554.83
Tao Mei54702288.54