Title
Can Researchers Assess the Suitability of Datasets to Answer Their Research Questions, with Access to Metadata Only?
Abstract
Health research increasingly requires effective ways to identify existing datasets and assess their suitability for research. We sought to test whether researchers could use an existing metadata catalogue to assess the suitability of datasets for addressing specified research questions. Five datasets were described in the National Institute for Health Research Health Informatics Collaborative metadata catalogue, and for each dataset five associated research questions were formulated, some of which were answerable with the dataset while others were not. Thirteen researchers each assessed whether the ten questions associated with two randomly selected datasets were answerable with the described datasets. After removing instances where participants misunderstood the question or lacked subject matter knowledge to make the assessment, we found that 87 out of 109 assessments (80%) were correct. Participants particularly struggled with one dataset which consisted of EHR data. The most common reason for incorrect assessments was the inability to find the relevant information in the metadata catalogue.
Year
DOI
Venue
2021
10.3233/SHTI220033
World Congress on Medical and Health (Medical) Informatics (MedInfo)
Keywords
DocType
Volume
Cataloguing,Data Aggregation,Metadata
Conference
290
ISSN
Citations 
PageRank 
1879-8365
0
0.34
References 
Authors
0
10
Name
Order
Citations
PageRank
George Tilston100.34
Richard Williams200.34
Emily Griffiths300.34
Sarah Al-Adely400.34
Saskia Lawson-Tovey500.34
Will Hulme600.34
Andrea Short700.34
Jim Davies867380.95
James Welch900.34
Niels Peek1023743.61