Title
Automatic drive annotation via multimodal latent topic model.
Abstract
Time-series driving behavioral data and image sequences captured with car-mounted video cameras can be annotated automatically in natural language, for example, "in a traffic jam," "leading vehicle is a truck," or "there are three and more lanes." Various driving support systems nowadays have been developed for safe and comfortable driving. To develop more effective driving assist systems, abstractive recognition of driving situation performed just like a human driver is important in order to achieve fully cooperative driving between the driver and vehicle. To achieve human-like annotation of driving behavioral data and image sequences, we first divided continuous driving behavioral data into discrete symbols that represent driving situations. Then, using multimodal latent Dirichlet allocation, latent driving topics laid on each driving situation were estimated as a relation model among driving behavioral data, image sequences, and human-annotated tags. Finally, automatic annotation of the behavioral data and image sequences can be achieved by calculating the predictive distribution of the annotations via estimated latent-driving topics. The proposed method intuitively annotated more than 50,000 pieces of frame data, including urban road and expressway data. The effectiveness of the estimated drive topics was also evaluated by analyzing the performances of driving-situation classification. The topics represented the drive context efficiently, i.e., the drive topics lead to a 95% lower-dimensional feature space and 6% higher accuracy compared with a high-dimensional raw-feature space. Moreover, the drive topics achieved performance almost equivalent performance to human annotators, especially in classifying traffic jams and the number of lanes.
Year
DOI
Venue
2013
10.1109/IROS.2013.6696744
IROS
Keywords
Field
DocType
driver information systems,image classification,image sequences,natural language interfaces,time series,video cameras,abstractive recognition,automatic drive annotation method,car-mounted video cameras,continuous driving behavioral data,discrete symbols,driving assist systems,driving support systems,driving-situation classification,estimated latent-driving topics,expressway data,frame data,fully cooperative driving,high-dimensional raw-feature space,human driver,human-annotated tags,human-like annotation,image sequences,lower-dimensional feature space,multimodal latent Dirichlet allocation,multimodal latent topic model,natural language,predictive annotation distribution,relation model,time-series driving behavioral data,urban road
Truck,Computer vision,Latent Dirichlet allocation,Feature vector,Annotation,Computer science,Support system,Natural language,Artificial intelligence,Topic model,Contextual image classification
Conference
ISSN
Citations 
PageRank 
2153-0858
9
0.49
References 
Authors
13
4
Name
Order
Citations
PageRank
Takashi Bando112314.55
Kazuhito Takenaka2737.41
Shogo Nagasaka3766.02
Tadahiro Taniguchi420133.56