Title
Predicting Vulnerabilities in Computer-Supported Inferential Analysis under Data Overload
Abstract
Data overload is a condition where a practitioner, supported by artifacts and other practitioners, finds it extremely challenging to focus in on, assemble, and synthesize the significant subset of data for the problem context into a coherent situation assessment, where the subset is a small portion of a vast data field. In order to predict vulnerabilities in intelligence analysis that might arise when traditional strategies for coping with data overload are undermined, we conducted an observational study in a simulated setting. Ten professional intelligence analysts analyzed the causes and impacts of the Ariane 501 accident. When study participants performed a time- pressured analysis outside their base of expertise based on sampling reports from a large set, some made inaccurate statements in verbal briefings. Participants that made no inaccurate statements spent more time during the analysis, read more documents, and relied on higher quality documents than participants who made inaccurate statements. All participants missed potentially available relevant information and had difficulty detecting and resolving data conflicts. Sources of inaccurate statements were: 1) relying upon default assumptions, 2) incorporating inaccurate information, and 3) incorporating information that was considered accurate at one point in time. These findings have design implications and point to evaluation criteria for systems designed to address the data overload problem in intelligence analysis.
Year
DOI
Venue
2001
10.1007/s10111-001-8004-y
Cognition, Technology & Work
Keywords
Field
DocType
Key words: Cognitive task analysis – Data overload – Information retrieval – Intelligence analysis – Observation – Simulation
Data field,Information overload,Observational study,Simulation,Coping (psychology),Human factors and ergonomics,Situation analysis,Engineering,Intelligence analysis,Vulnerability
Journal
Volume
Issue
Citations 
3
4
24
PageRank 
References 
Authors
1.73
6
3
Name
Order
Citations
PageRank
Emily S. Patterson123127.89
Emilie M. Roth216620.64
D. Woods31287229.36