Title
Embedded Multimodal Registration of Visible Images on Long-Wave Infrared Video in Real Time
Abstract
We describe an embedded system architecture that implements a real-time multimodal registration method which enables multicamera spatio-temporal feature extraction from the combination of visible and long-wave infrared image sequence. Image registration is performed by matching common features between each frame of a visible image to each frame of an infrared image sequence, in order to estimate an affine transformation between each pair of images. The parameters of this affine transformation are estimated recursively on line with the video, thus enabling image registration in real time. The registration algorithm is implemented using a combination of embedded software and dedicated hardware units on a heterogeneous reconfigurable system-on-a-chip. The hardware performs feature detection and extraction, whereas the software estimates the transformation parameters and maps each infrared video frame onto the visible image coordinates. Our prototype implementation runs with a 135MHz clock, consumes 1.8W and utilizes 29% and 54% of the configurable logic and hardware multiplier units available on the chip, respectively.
Year
DOI
Venue
2016
10.1109/DSD.2016.99
2016 Euromicro Conference on Digital System Design (DSD)
Keywords
Field
DocType
Long-wave infrared,image registration,embedded systems,video processing,FPGA
Affine transformation,Computer graphics (images),Computer science,Image processing,Real-time computing,Software,Artificial intelligence,Computer vision,Video processing,Embedded software,Field-programmable gate array,Feature extraction,Image registration
Conference
ISBN
Citations 
PageRank 
978-1-5090-2818-4
4
0.52
References 
Authors
5
4
Name
Order
Citations
PageRank
Fabian Inostroza151.23
Javier Cardenas241.53
Sebastian E. Godoy383.44
Miguel Figueroa425732.96