Name
Title | ||
|---|---|---|
View graph construction for scenes with duplicate structures via graph convolutional network |
Abstract | ||
|---|---|---|
View graph construction aims to effectively organise disordered image dataset through image retrieval technique before structure from motion (SfM). Existing view graph construction methods usually fail to handle scenes with duplicate structure, because these methods solely treat the construction of view graph as a process of image-pair-wise matching and lack in exploiting images' topological details in dataset. In this paper, we handle this problem from a novel perspective to construct view graph in a global paradigm by introducing an end-to-end graph convolutional network (GCN). First, a location-aware embedding module is introduced to encode images into a feature space that takes into account the feature's location by using Vision Transformer architecture, improving the distinction between features of duplicate structure. Second, graph convolutional network that consists of topological relationship preserving module and feature metric learning module is proposed. Topological relationship preserving network is proposed to help nodes maintain their connected neighbourhood features. By merging the topological connected information into images' embedding, our method can process image matching in a global mode, thus improving the disambiguation ability for images with duplicate scenes. Then a feature metric learning network is embedded into GCN to dynamically compute the linkage prediction among nodes based on their features. Finally, our method combines these three parts to jointly optimise nodes' features and linkage prediction in an end-to-end paradigm. We make qualitative and quantitative comparisons based on three public benchmark datasets and demonstrate that our proposed method performs favourably against other state-of-the-art methods. |
Year | DOI | Venue |
|---|---|---|
2022 | 10.1049/cvi2.12095 | IET COMPUTER VISION |
Keywords | DocType | Volume |
graph convolutional network, image embedding, metric learing, view graph construction | Journal | 16 |
Issue | ISSN | Citations |
5 | 1751-9632 | 0 |
PageRank | References | Authors |
0.34 | 0 | 5 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Yang Peng | 1 | 0 | 0.34 |
| Shen Yan | 2 | 0 | 0.34 |
| Yuxiang Liu | 3 | 0 | 0.34 |
| Yu Liu | 4 | 198 | 25.45 |
| Maojun Zhang | 5 | 314 | 48.74 |