Paper Info
Title
Textout: Detecting Text-Layout Bugs in Mobile Apps via Visualization-Oriented Learning
Abstract
Layout bugs commonly exist in mobile apps. Due to the fragmentation issues of smartphones, a layout bug may occur only on particular versions of smartphones. It is quite challenging to detect such bugs for state-of-the-art commercial automated testing platforms, although they can test an app with thousands of different smartphones in parallel. The main reason is that typical layout bugs neither crash an app nor generate any error messages. In this paper, we present our work for detecting text-layout bugs, which account for a large portion of layout bugs. We model text-layout bug detection as a classification problem. This then allows us to address it with sophisticated image processing and machine learning techniques. To this end, we propose an approach which we call Textout. Textout takes screenshots as its input and adopts a specifically-tailored text detection method and a convolutional neural network (CNN) classifier to perform automatic text-layout bug detection. We collect 33,102 text-region images as our training dataset and verify the effectiveness of our tool with 1,481 text-region images collected from real-world apps. Textout achieves an AUC (area under the curve) of 0.956 on the test dataset and shows an acceptable overhead. The dataset is open-source released for follow-up research.
Year
DOI
Venue
2019
10.1109/ISSRE.2019.00032
2019 IEEE 30th International Symposium on Software Reliability Engineering (ISSRE)
Keywords
Field
DocType
mobile application testing,GUI testing,GUI bug detection,text-layout bug detection,deep learning
Crash,Computer science,Visualization,Convolutional neural network,Image processing,Real-time computing,Artificial intelligence,Graphical user interface testing,Deep learning,Classifier (linguistics),Mobile apps,Machine learning
Conference
ISSN
ISBN
Citations 
1071-9458
978-1-7281-4983-7
0
PageRank 
References 
Authors
0.34
0
5
Name
Order
Citations
PageRank
Yaohui Wang100.34
hui xu2163.93
Yangfan Zhou323229.72
Michael R. Lyu463.15
Xin Wang544559.14