Paper Info
Title
Apparent resolution enhancement for motion videos
Abstract
In this work we increase the apparent resolution of videos when viewed on a high-refresh rate display by making use of perceptual properties of the visual system. We achieve this enhancement by exploiting the viewer's natural tendency to track moving objects in videos which causes the screen pixels to be projected at different sub-pixel offsets onto the retina. We estimate the eye motion using optical flow and use it to compute multiple low-resolution frames for each input frame. By watching these new frames at a high frame-rate, the viewer's eyes integrate them over time and merges them into a single perceived frame with a denser pixel layout. In this work we also advance the existing approaches for resolution enhancement in the following ways. We combine current display resolution enhancement with super-resolution methods to enhance input videos that are at the display resolution. We derive a new perceived video model that accounts for actual camera sensor and display pixel shapes in order to achieve optimal enhancement. We analyze the degeneracies that certain motion velocities introduce to super-resolution and resolution enhancement, and offer algorithmic solutions for handling these scenarios as well as other difficulties that arise when dealing with the optical flow of natural videos. A user study finds that our approach achieves a noticeable increase in the apparent resolution for videos even when viewed on regular hardware (60Hz), and further enhances resolution when viewed on higher refresh rate displays (120Hz).
Year
DOI
Venue
2012
10.1145/2338676.2338695
SAP
Keywords
Field
DocType
apparent resolution,display resolution,high-refresh rate display,motion video,optical flow,display pixel,optimal enhancement,apparent resolution enhancement,higher refresh rate display,certain motion velocity,current display resolution enhancement,resolution enhancement,image processing,super resolution,computational photography,visual system,low resolution
Computer vision,Computer graphics (images),Display resolution,Image sensor,Computer science,Computational photography,Image processing,Refresh rate,Artificial intelligence,Pixel,Optical flow
Conference
Citations 
PageRank 
References 
4
0.45
9
Authors
2
Name
Order
Citations
PageRank
Floraine Berthouzoz124312.65
Raanan Fattal22440119.13