Abstract | ||
---|---|---|
In this paper, we propose a virtual 3D Eyeglasses Try-on (3DET) system, with efficient, realistic and real-time augmented performance. The 3DET system captures user's performance with the help of depth camera and renders the glasses properly on the video stream immediately after user's selection. The virtual eye-glasses follow with the motion (movement or rotation) of user's head simultaneously. The high efficiency of our 3DET system is achieved by simplifying the eyeglasses matching procedure, making use of the active appearance model (AAM) based face tracking algorithm. This is completely different from existing methods, which usually relies on eye detection. In addition, due to the exploiting of a generic 3D face model during tracking and displaying, the 3DET system can handle occlusion problem easily and render realistic glasses in videos effectively. Experimental results demonstrate that the proposed 3DET system is able to produce superior natural and smooth visual results with virtual glasses fitted on the users face at 30 fps with a high level of accuracy on common hardware. |
Year | DOI | Venue |
---|---|---|
2014 | 10.1109/ICMEW.2014.6890545 | ICME Workshops |
Keywords | Field | DocType |
depth camera,realistic glasses,active appearance model based face tracking algorithm,3d face model,virtual glasses,occlusion problem,virtual try-on,aam,image sensors,real-time augmented performance,augmented reality,marketing,video stream,object tracking,video streaming,virtual eye-glasses,3det system,virtual 3d eyeglasses try-on system,face tracking,shape,solid modeling,glass,face,tracking | Computer vision,Computer graphics (images),Computer science,Augmented reality,Active appearance model,Artificial intelligence,Solid modeling,Eye detection,Facial motion capture | Conference |
ISSN | Citations | PageRank |
1945-7871 | 4 | 0.45 |
References | Authors | |
6 | 5 |
Name | Order | Citations | PageRank |
---|---|---|---|
Difei Tang | 1 | 5 | 0.81 |
Juyong Zhang | 2 | 4 | 0.45 |
Ketan Tang | 3 | 106 | 12.98 |
Lingfeng Xu | 4 | 53 | 9.81 |
Lu Fang | 5 | 343 | 55.27 |