Title
Source Selection Languages: A Usability Evaluation
Abstract
When looking to obtain insights from data, and given numerous possible data sources, there are certain quality criteria that retrieved data from selected sources should exhibit so as to be most fit-for-purpose. An effective source selection algorithm can only provide good results in practice if the requirements of the user have been suitably captured, and therefore, an important consideration is how users can effectively express their requirements. In this paper, we carry out an experiment to compare user performance in two different languages for expressing user requirements in terms of data quality characteristics, pairwise comparison of criteria values, and single objective constrained optimization. We employ crowdsourcing to evaluate, for a set of tasks, user ability to choose effective formulations in each language. The results of this initial study show that users were able to determine more effective formulations for the tasks using pairwise comparisons. Furthermore, it was found that users tend to express a preference for one language over the other, although it was not necessarily the language that they performed best in.
Year
DOI
Venue
2018
10.1145/3209900.3209906
HILDA@SIGMOD
Keywords
Field
DocType
Information integration, data wrangling, source selection, data quality, decision analysis
Data mining,Information integration,Pairwise comparison,Data quality,Information retrieval,Computer science,Crowdsourcing,Selection algorithm,Usability,User requirements document,Constrained optimization
Conference
ISBN
Citations 
PageRank 
978-1-4503-5827-9
1
0.38
References 
Authors
8
3
Name
Order
Citations
PageRank
Ixent Galpin11299.20
Edward Abel2244.85
Norman W. Paton33059359.26