Title
Structure-Aware Deep Learning for Product Image Classification
Abstract
Automatic product image classification is a task of crucial importance with respect to the management of online retailers. Motivated by recent advancements of deep Convolutional Neural Networks (CNN) on image classification, in this work we revisit the problem in the context of product images with the existence of a predefined categorical hierarchy and attributes, aiming to leverage the hierarchy and attributes to improve classification accuracy. With these structure-aware clues, we argue that more advanced deep models could be developed beyond the flat one-versus-all classification performed by conventional CNNs. To this end, novel efforts of this work include a salient-sensitive CNN that gazes into the product foreground by inserting a dedicated spatial attention module; a multiclass regression-based refinement that is expected to predict more accurately by merging prediction scores from multiple preceding CNNs, each corresponding to a distinct classifier in the hierarchy; and a multitask deep learning architecture that effectively explores correlations among categories and attributes for categorical label prediction. Experimental results on nearly 1 million real-world product images basically validate the effectiveness of the proposed efforts individually and jointly, from which performance gains are observed.
Year
DOI
Venue
2019
10.1145/3231742
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)
Keywords
Field
DocType
Image classification, category hierarchy, convolutional neural network, multi-class regression, multi-task learning
Architecture,Multi-task learning,Categorical variable,Computer science,Convolutional neural network,Artificial intelligence,Deep learning,Classifier (linguistics),Hierarchy,Contextual image classification,Multimedia,Machine learning
Journal
Volume
Issue
ISSN
15
1s
1551-6857
Citations 
PageRank 
References 
5
0.49
35
Authors
3
Name
Order
Citations
PageRank
Zhineng Chen119225.29
Shanshan Ai270.85
Caiyan Jia38113.07