Title
TimNet: A text-image matching network integrating multi-stage feature extraction with multi-scale metrics
Abstract
Text image comparison is a core component in web consistency testing across browsers. Previous studies mainly focused on general image comparison, which could not best suit the proposed task since text images share unique properties. In this paper, we introduce a novel Text-Image Matching Network (TimNet) to detect text differences in image pairs. A Multi-Stage Feature Extraction module (MFE) is integrated in TimNet to extract not only non-textual content features but also text-like features that are temporally aligned. Moreover, TimNet is composed of a Multi-Scale Metric module (MM) to measure the similarity between two text images with various scales and aspect ratios. Accordingly, a Text-Image Similarity Database (TISDB) consisting of 615.6 k text-image pairs of English characters, Chinese characters, and Arabic numbers was established. Extensive experiments were conducted to demonstrate that our TimNet outperforms existing state-of-the-art methods.
Year
DOI
Venue
2021
10.1016/j.neucom.2021.09.001
Neurocomputing
Keywords
DocType
Volume
Text image similarity,Variable aspect ratio,Convolution neural network,Multi-stage feature extraction,Multi-scale metric
Journal
465
ISSN
Citations 
PageRank 
0925-2312
0
0.34
References 
Authors
0
5
Name
Order
Citations
PageRank
Xiaoqi Zheng100.34
Yingfan Tao200.34
Ruikai Zhang300.34
WM422134.28
QM546472.05