Name
Abstract | ||
|---|---|---|
We here study the problem of visual attention computation in video of driving environment via the learning from eye movements. We collect a large-scale database of eye movements from 28 subjects on 30 videos of road scenes, which simulate the driving environment. The analysis on this eye movement database reveals that visual attention in driving environment is directed by high-level cognitive factors such as objects. We then present a new high-level representation called Traffic Object Bank (TOB), which is comprised of many individual road object detectors trained comprehensively in semantic space as well as viewpoint space. TOB provides semantically rich object-level features. Finally, we develop a computational model to predict where drivers look via the mapping from TOB-based representation and to gaze data. Experimental results on our traffic scene video benchmark indicate high accordance with human eye movement and show great promise for further applications. |
Year | DOI | Venue |
|---|---|---|
2014 | 10.1109/ICME.2014.6890215 | ICME |
Keywords | Field | DocType |
high-level cognitive factors,video signal processing,traffic object bank,driving environment video,visual attention,semantic space,traffic engineering computing,gaze tracking,salient traffic object detection,eye movement database,road scene videos,high-level representation,tob-based representation,object detection,semantically rich object-level features,individual road object detectors,traffic scene video benchmark,viewpoint space,road traffic,visual attention computation,computational model,eye movement,computational modeling,detectors,visualization,feature extraction | Human eye,Computer vision,Gaze,Visualization,Computer science,Feature extraction,Visual attention,Eye movement,Artificial intelligence,Cognition,Computation | Conference |
ISSN | Citations | PageRank |
1945-7871 | 0 | 0.34 |
References | Authors | |
0 | 6 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Junwei Han | 1 | 3501 | 194.57 |
| Liye Sun | 2 | 3 | 1.74 |
| Dingwen Zhang | 3 | 1183 | 36.03 |
| Xintao Hu | 4 | 118 | 13.53 |
| Gong Cheng | 5 | 1020 | 40.17 |
| Lei Guo | 6 | 1661 | 142.63 |