Title
Understanding HCI Practices and Challenges of Experiment Reporting with Brain Signals: Towards Reproducibility and Reuse
Abstract
AbstractIn human-computer interaction (HCI), there has been a push towards open science, but to date, this has not happened consistently for HCI research utilizing brain signals due to unclear guidelines to support reuse and reproduction. To understand existing practices in the field, this paper examines 110 publications, exploring domains, applications, modalities, mental states and processes, and more. This analysis reveals variance in how authors report experiments, which creates challenges to understand, reproduce, and build on that research. It then describes an overarching experiment model that provides a formal structure for reporting HCI research with brain signals, including definitions, terminology, categories, and examples for each aspect. Multiple distinct reporting styles were identified through factor analysis and tied to different types of research. The paper concludes with recommendations and discusses future challenges. This creates actionable items from the abstract model and empirical observations to make HCI research with brain signals more reproducible and reusable.
Year
DOI
Venue
2022
10.1145/3490554
ACM Transactions on Computer-Human Interaction
Keywords
DocType
Volume
Brain sensing, electroencephalography, EEG, functional near-infrared spectroscopy, fNIRS, experiment model, reproducibility
Journal
29
Issue
ISSN
Citations 
4
1073-0516
0
PageRank 
References 
Authors
0.34
0
5
Name
Order
Citations
PageRank
Felix Putze120529.73
Susanne Putze253.15
Merle Sagehorn300.34
Christopher Micek400.34
Erin T. Solovey573048.09