Paper Info
Title
Seeing the Sound: A New Multimodal Imaging Device for Computer Vision
Abstract
Audio imaging can play a fundamental role in computer vision, in particular in automated surveillance, boosting the accuracy of current systems based on standard optical cameras. We present here a new hybrid device for acoustic-optic imaging, whose characteristics are tailored to automated surveillance. In particular, the device allows realtime, high frame rate generation of an acoustic map, overlaid over a standard optical image using a geometric calibration of audio and video streams. We demonstrate the potentialities of the device for target tracking on three challenging setup showing the advantages of using acoustic images against baseline algorithms on image tracking. In particular, the proposed approach is able to overcome, often dramatically, visual tracking with state-of-art algorithms, dealing efficiently with occlusions, abrupt variations in visual appearence and camouflage. These results pave the way to a widespread use of acoustic imaging in application scenarios such as in surveillance and security.
Year
DOI
Venue
2015
10.1109/ICCVW.2015.95
ICCV Workshops
Keywords
Field
DocType
multimodal imaging device,computer vision,audio imaging,automated surveillance,standard optical cameras,hybrid device,acoustic-optic imaging,real-time-high-frame rate generation,acoustic map,standard optical image,geometric calibration,audio streams,video streams,target tracking,acoustic images,image tracking,visual tracking,abrupt variations,visual appearence,camouflage
Computer vision,Visualization,Computer science,Imaging science,Camouflage,Eye tracking,Video tracking,Artificial intelligence,Frame rate,Boosting (machine learning),Calibration
Conference
Volume
Issue
Citations 
2015
1
3
PageRank 
References 
Authors
0.40
13
6
Name
Order
Citations
PageRank
Andrea Zunino1155.95
Marco Crocco214914.30
Samuele Martelli3314.77
A Trucco4589.23
Alessio Del Bue563747.05
Vittorio Murino63277207.20