Title
Task-based scanpath assessment of multi-sensor video fusion in complex scenarios
Abstract
The combining of visible light and infrared visual representations occurs naturally in some creatures, including the rattlesnake. This process, and the wide-spread use of multi-spectral multi-sensor systems, has influenced research into image fusion methods. Recent advances in image fusion techniques have necessitated the creation of novel ways of assessing fused images, which have previously focused on the use of subjective quality ratings combined with computational metric assessment. Previous work has shown the need to apply a task to the assessment process; the current work continues this approach by extending the novel use of scanpath analysis. In our experiments, participants were shown two video sequences, one in high luminance (HL) and one in low luminance (LL), both featuring a group of people walking around a clearing of trees. Each participant was shown visible and infrared (IR) inputs alone; and side-by-side (SBS); in an average (AVE) fused; a discrete wavelet transform (DWT) fused; and a dual-tree complex wavelet transform (DT-CWT) fused displays. Participants were asked to track one individual in each video sequence, as well as responding by key press when other individuals carried out secondary actions. Results showed the SBS display to lead to much poorer accuracy than the other displays, while reaction times in carrying out the secondary task favoured AVE in the HL sequence and DWT in the LL sequence. Results are discussed in relation to previous findings regarding item saliency and task demands, and the potential for comparative experiments evaluating human performance when viewing fused sequences against naturally occurring fusion processes such as the rattlesnake is highlighted.
Year
DOI
Venue
2010
10.1016/j.inffus.2009.04.007
Information Fusion
Keywords
Field
DocType
task demand,secondary task,complex scenario,fused display,fused sequence,novel use,psychophysics,scanpath analysis,image fusion method,task-based scanpath assessment,video assessment,hl sequence,image fusion,image fusion technique,eye-tracking,fused image,multi-sensor video fusion,video sequence,discrete wavelet transform,eye tracking,human performance,visible light,reaction time,infrared
Computer vision,Pattern recognition,Image fusion,Salience (neuroscience),Eye tracking,Artificial intelligence,Discrete wavelet transform,Luminance,Complex wavelet transform,Psychophysics,Video fusion,Mathematics
Journal
Volume
Issue
ISSN
11
1
Information Fusion
Citations 
PageRank 
References 
3
0.43
11
Authors
9
Name
Order
Citations
PageRank
Timothy D. Dixon1131.93
Stavri G. Nikolov224612.64
John J. Lewis32269.44
Jian Li4303.05
Eduardo Fernandez Canga530.43
Jan M. Noyes613121.41
Tom Troscianko739141.87
David R. Bull81736189.86
C. Nishan Canagarajah9191.76