Title
Robust super-resolution in a multiview setup based on refined high-frequency synthesis
Abstract
Increasing image sharpness and thus improving the visual quality is an important task in multiview image and video processing. We propose a novel super-resolution approach for multiview images in a mixed-resolution setup that is robust to various depth map distortions. The considered distortion scenarios may be caused by an inaccurate calibration of the depth camera or a limitation of depth range. Our method is based on a refined high-frequency synthesis that relies on a blockwise and depth-dependant low-frequency registration. The refinement step efficiently adapts the high-frequency content from a neighboring high-resolution camera to a low-resolution view and thereby compensates the displacement caused by depth inaccuracies. In case of undistorted depth maps, the results show that our algorithm leads to a PSNR gain of up to 1.33 dB with respect to a comparable unrefined super-resolution approach for a mixed-resolution multiview video plus depth format. Compared to the initial low-resolution view, a PSNR gain of up to 2.61 dB is obtained. In case of distorted depth maps, a PSNR gain of even 4.78 dB is achieved with respect to the reference superresolution algorithm. The PSNR gains get confirmed by the corresponding SSIM values which manifest a similar behaviour. The improvement of visual quality is also convincingly for all considered scenarios.
Year
DOI
Venue
2012
10.1109/MMSP.2012.6343407
Multimedia Signal Processing
Keywords
Field
DocType
image enhancement,image registration,image resolution,video signal processing,PSNR gain,SSIM value,blockwise low-frequency registration,depth camera inaccurate calibration,depth inaccuracy,depth map distortion,depth range limitation,depth-dependent low-frequency registration,displacement compensation,distorted depth map,distortion scenario,high-resolution camera,image sharpness,mixed-resolution setup,multiview image,multiview setup,refined high-frequency synthesis,refinement step,robust superresolution,superresolution algorithm,superresolution approach,video processing,visual quality improvement
Computer vision,Video processing,Frequency synthesis,Computer science,Artificial intelligence,Depth map,Distortion,Superresolution,Image resolution,Calibration,Image registration
Conference
ISSN
ISBN
Citations 
2163-3517
978-1-4673-4571-2
7
PageRank 
References 
Authors
0.55
6
4
Name
Order
Citations
PageRank
Thomas Richter1409.67
Jürgen Seiler214528.28
Wolfgang Schnurrer3214.48
André Kaup4861127.24