Title
Multiple Object Detection and Tracking in the Thermal Spectrum
Abstract
Multiple Object Tracking (MOT) is an integral part of machine vision research. Most tracking-by-detection based MOT solutions utilize video streams from RGB cameras for their operation. However, for real-world applications, it is necessary to utilize sensors that operate in different spectrums to accommodate for varying lighting conditions. Since object detection is the first step of the tracking pipeline in tracking-by-detection approaches, we compare the performance of state-of-the-art object detectors when trained on color images to their performance when trained on thermal images. We introduce a new dataset for multiple object tracking with thermal images and corresponding RGB images and show that state-of-the-art trackers perform better on thermal images, especially in poor lighting conditions. Finally, we propose the use of a dynamic cut-off thresh-old for tracking-by-detection approaches that factors the size of a predicted box to enhance the tracker association. Our dataset and source code are publicly available at https://github.com/wassimea/thermalMOT
Year
DOI
Venue
2022
10.1109/CVPRW56347.2022.00042
2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
Keywords
DocType
Volume
thermal images,lighting conditions,tracking-by-detection approaches,multiple object detection,thermal spectrum,multiple object tracking,machine vision research,tracking-by-detection based MOT solutions,tracking pipeline,color images,RGB cameras,video streams
Conference
2022
Issue
ISSN
ISBN
1
2160-7508
978-1-6654-8740-5
Citations 
PageRank 
References 
0
0.34
5
Authors
6