Paper Info
Title
Where is that Button Again?! - Towards a Universal GUI Search Engine.
Abstract
In feature-rich software a wide range of functionality is spread across various menus, dialog windows, tool bars etc. Remembering where to find each feature is usually very hard, especially if it is not regularly used. We therefore provide a GUI search engine which is universally applicable to a large number of applications. Besides giving an overview of related approaches, we describe three major problems we had to solve, which are analyzing the GUI, understanding the users' query and executing a suitable solution to find a desired UI element. Based on a user study we evaluated our approach and showed that it is particularly useful if a not regularly used feature is searched for. We already identified much potential for further applications based on our approach.
Year
DOI
Venue
2017
10.5220/0006201402170227
ICAART: PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE, VOL 2
Keywords
Field
DocType
Information Retrieval,GUI automation,Accessibility Interface
Dialog box,Data mining,World Wide Web,Search engine,Computer science,Human–computer interaction,Software
Conference
Citations 
PageRank 
References 
1
0.36
0
Authors
4
Name
Order
Citations
PageRank
Sven Hertling16112.33
Markus Schröder212.05
Christian Jilek312.73
Andreas Dengel41926280.42