Paper Info
Title
A novel compressive sensing approach to simultaneously acquire color and near-infrared images on a single sensor
Abstract
Sensors of most digital cameras are made of silicon that is inherently sensitive to both the visible and near-infrared parts of the electromagnetic spectrum. In this paper, we address the problem of color and NIR joint acquisition. We propose a framework for the joint acquisition that uses only a single silicon sensor and a slightly modified version of the Bayer color-filter array that is already mounted in most color cameras. Implementing such a design for an RGB and NIR joint acquisition system requires minor changes to the hardware of commercial color cameras. One of the important differences between this design and the conventional color camera is the post-processing applied to the captured values to reconstruct full resolution images. By using a CFA similar to Bayer, the sensor records a mixture of NIR and one color channel in each pixel. In this case, separating NIR and color channels in different pixels is equivalent to solving an under-determined system of linear equations. To solve this problem, we propose a novel algorithm that uses the tools developed in the field of compressive sensing. Our method results in high-quality RGB and NIR images (the average PSNR of more than 30 dB for the reconstructed images) and shows a promising path towards RGB and NIR cameras.
Year
DOI
Venue
2013
10.1109/ICASSP.2013.6637931
Acoustics, Speech and Signal Processing
Keywords
Field
DocType
cameras,compressed sensing,elemental semiconductors,image coding,image colour analysis,image reconstruction,image resolution,image sensors,infrared imaging,silicon,Bayer color-filter array,CFA,NIR joint acquisition,NIR joint acquisition system,NIR mixture,RGB joint acquisition system,Si,color cameras,color images,commercial color cameras,compressive sensing approach,digital cameras,electromagnetic spectrum,full resolution image reconstruction,high-quality NIR images,high-quality RGB images,linear equations,near-infrared images,near-infrared parts,single silicon sensor,Color filter array,compressive sensing,demosaicing,near-infrared,sparse decomposition,the Bayer CFA
Bayer filter,Color co-site sampling,Computer vision,Pattern recognition,Computer science,Demosaicing,Color depth,Artificial intelligence,RGB color model,Color filter array,Image resolution,Channel (digital image)
Conference
ISSN
Citations 
PageRank 
1520-6149
9
0.68
References 
Authors
13
3
Name
Order
Citations
PageRank
Zahra Sadeghipoor1273.61
Yue M. Lu267760.17
Sabine Süsstrunk34984207.02