Name
Abstract | ||
|---|---|---|
Automatically generation of an image description is a challenging task which attracts broad attention in artificial intelligence. Inspired by methods of computer vision and natural language processing, different approaches have been proposed to solve the problem. However, captions generated by the existing approaches have been lack of enough contextual information to describe the corresponding images completely. The labeled captions in the training set only basically describe images and lack of enough contextual annotations. In this paper, we propose a Weakly-supervised Image Captioning Approach (WICA) to generate captions containing rich contextual information, without complete annotations for the contextual information in datasets. We utilize encoder-decoder neural networks to extract basic captioning features and leverage object detection networks to identify contextual features. Then, we encode the two levels of features by a phrase-based language model in order to generate captions with rich contextual information. The comprehensive experimental results reveal that proposed model outperforms the existing baselines in terms of on the richness and reasonability of contextual information for image captioning. © 2017 Springer Science+Business Media, LLC |
Year | DOI | Venue |
|---|---|---|
2018 | 10.1007/s11042-017-5236-2 | Multimedia Tools Appl. |
Keywords | Field | DocType |
Encoder-decoder neural networks,Image captioning,Object detection,Phrase-based language model,Rich contextual information,Weakly-supervised learning | Computer vision,Object detection,ENCODE,Closed captioning,Contextual information,Computer science,Phrase,Natural language processing,Artificial intelligence,Contextual image classification,Artificial neural network,Language model | Journal |
Volume | Issue | ISSN |
77 | 14 | 13807501 |
Citations | PageRank | References |
4 | 0.51 | 21 |
Authors | ||
6 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Zheng Hai-Tao | 1 | 142 | 24.39 |
| Wang Zhe | 2 | 4 | 0.85 |
| Ningning Ma | 3 | 48 | 3.09 |
| Chen Jin-Yuan | 4 | 22 | 3.27 |
| Xiao X. | 5 | 79 | 15.95 |
| Arun Kumar | 6 | 1427 | 132.32 |