Title
A comparison of 3D shape retrieval methods based on a large-scale benchmark supporting multimodal queries
Abstract
Build a large-scale 3D shape retrieval benchmark that supports multi-modal queries.Evaluate the 26 3D shape retrieval methods using 3 types of metrics.Solicit and identify state-of-the-art methods and promising related techniques.Perform detailed analysis on diverse methods w.r.t accuracy and efficiency.Make benchmark and evaluation tools freely available to the community. Large-scale 3D shape retrieval has become an important research direction in content-based 3D shape retrieval. To promote this research area, two Shape Retrieval Contest (SHREC) tracks on large scale comprehensive and sketch-based 3D model retrieval have been organized by us in 2014. Both tracks were based on a unified large-scale benchmark that supports multimodal queries (3D models and sketches). This benchmark contains 13680 sketches and 8987 3D models, divided into 171 distinct classes. It was compiled to be a superset of existing benchmarks and presents a new challenge to retrieval methods as it comprises generic models as well as domain-specific model types. Twelve and six distinct 3D shape retrieval methods have competed with each other in these two contests, respectively. To measure and compare the performance of the participating and other promising Query-by-Model or Query-by-Sketch 3D shape retrieval methods and to solicit state-of-the-art approaches, we perform a more comprehensive comparison of twenty-six (eighteen originally participating algorithms and eight additional state-of-the-art or new) retrieval methods by evaluating them on the common benchmark. The benchmark, results, and evaluation tools are publicly available at our websites (http://www.itl.nist.gov/iad/vug/sharp/contest/2014/Generic3D/, 2014, http://www.itl.nist.gov/iad/vug/sharp/contest/2014/SBR/, 2014).
Year
DOI
Venue
2015
10.1016/j.cviu.2014.10.006
Computer Vision and Image Understanding
Keywords
Field
DocType
3D shape retrieval,Large-scale benchmark,Multimodal queries,Unified,Performance evaluation,Query-by-Model,Query-by-Sketch,SHREC
Subset and superset,Information retrieval,Computer science,CONTEST,Query by sketch,Sketch
Journal
Volume
Issue
ISSN
131
C
1077-3142
Citations 
PageRank 
References 
41
1.14
105
Authors
22
Search Limit
100105
Name
Order
Citations
PageRank
Bo Li125715.09
Yijuan Lu273246.24
Chunyuan Li346733.86
Afzal Godil461930.70
Tobias Schreck51854123.28
M. Aono664360.79
Martin Burtscher7411.14
Qiang Chen8612.06
Nihad Karim Chowdhury9703.68
Bin Fang10612.06
Hongbo Fu11116773.64
Takahiko Furuya1241121.02
Haisheng Li13702.90
Jianzhuang Liu14161498.72
Henry Johan1535529.36
Ryuichi Kosaka16411.14
Hitoshi Koyanagi17411.14
R. Ohbuchi181710170.54
A. Tatsuma1918510.86
Yajuan Wan20411.14
Chaoli Zhang21411.14
Changqing Zou22411.14