Title
In a Blink of an Eye and a Switch of a Transistor: Cortically Coupled Computer Vision
Abstract
Our society's information technology advancements have resulted in the increasingly problematic issue of information overload-i.e., we have more access to information than we can possibly process. This is nowhere more apparent than in the volume of imagery and video that we can access on a daily basis-for the general public, availability of YouTube video and Google Images, or for the image analysis professional tasked with searching security video or satellite reconnaissance. Which images to look at and how to ensure we see the images that are of most interest to us, begs the question of whether there are smart ways to triage this volume of imagery. Over the past decade, computer vision research has focused on the issue of ranking and indexing imagery. However, computer vision is limited in its ability to identify interesting imagery, particularly as ¿interesting¿ might be defined by an individual. In this paper we describe our efforts in developing brain-computer interfaces (BCIs) which synergistically integrate computer vision and human vision so as to construct a system for image triage. Our approach exploits machine learning for real-time decoding of brain signals which are recorded noninvasively via electroencephalography (EEG). The signals we decode are specific for events related to imagery attracting a user's attention. We describe two architectures we have developed for this type of cortically coupled computer vision and discuss potential applications and challenges for the future.
Year
DOI
Venue
2010
10.1109/JPROC.2009.2038406
Proceedings of the IEEE
Keywords
Field
DocType
brain-computer interfaces,computer vision,decoding,electroencephalography,image coding,image sensors,learning (artificial intelligence),medical image processing,Google image triage,YouTube video,brain signal recording,brain-computer interfaces,cortically coupled computer vision,electroencephalography,eye blink,human vision,image analysis professional,imagery volume,information technology advancement,interesting imagery identification,machine learning,real-time decoding,satellite reconnaissance,security video searching,transistor switch,Brain–computer interface,computer vision,electroencephalography,image search,image triage
Computer vision,Image sensor,Visualization,Information technology,Computer science,Brain–computer interface,Image processing,Search engine indexing,Exploit,Artificial intelligence,Statistical classification,Multimedia
Journal
Volume
Issue
ISSN
98
3
0018-9219
Citations 
PageRank 
References 
25
1.64
2
Authors
10
Name
Order
Citations
PageRank
Paul Sajda13910.84
Pohlmeyer, E.2251.64
Jun Wang3251.64
L. C. Parra4312.54
C. Christoforou5251.64
J. Dmochowski6282.06
B. Hanna7251.64
C. Bahlmann8251.64
Manpreet Singh925526.46
Shih-Fu Chang10130151101.53