Paper Info
Title
The Image Annotation Method by Convolutional Features from Intermediate Layer of Deep Learning Based on Internet of Things
Abstract
Existing image annotation methods that employ convolutional features of deep learning methods from the Internet of Things (IoT) have a number of limitations, including complex training and high space/time expenses associated with the image annotation procedure. Accordingly, this paper proposes an innovative method in which the visual features of the image are presented by the intermediate layer features of deep learning, while semantic concepts are represented by mean vectors of positive samples. Firstly, the convolutional result is directly output in the form of low-level visual features through the mid-level of the pre-trained deep learning model, with the image being represented by sparse coding in the IoT. Secondly, the positive mean vector method is used to construct visual feature vectors for each text vocabulary item, so that a visual feature vector database is created. Finally, the visual feature vector similarity between the testing image and all text vocabulary is calculated, and the vocabulary with the largest similarity is taken from the IoT as the words used for annotation. Experiments on multiple datasets demonstrate the effectiveness of the proposed method; in terms of F1 score, the proposed method's performance on the Corel5k and IAPR TC-12 datasets is superior to that of MBRM, JEC-AF, JEC-DF, and 2PKNN with end-to-end deep features.
Year
DOI
Venue
2019
10.1109/MSN48538.2019.00066
2019 15th International Conference on Mobile Ad-Hoc and Sensor Networks (MSN)
Keywords
DocType
ISBN
deep learning, image annotation, convolutional result, positive mean vector, eigenvector, internet of things
Conference
978-1-7281-5213-4
Citations 
PageRank 
References 
0
0.34
8
Authors
6
Name
Order
Citations
PageRank
Yuantao Chen1325.61
Jiajun Tao262.08
jin wang324336.79
Zhuofan Liao4615.47
Jie Xiong5325.62
Lei Wang600.34