Title
Virtual reality check: Statistical power, reported results, and the validity of research on the psychology of virtual reality and immersive environments
Abstract
Virtual reality (VR) is a popular subject of scientific study across a variety of academic fields. In the present study we evaluate methodological trends in behavioral research on VR with respect to data collection practices, statistical reporting, and data availability. In line with this goal, we conducted a meta-scientific analysis of 61 articles encompassing a total of 1122 statistical tests and highlight three emergent trends that inform our understanding of past and future studies focused on VR. Conclusions from analysis of the data include a high incidence of errors in statistical reporting, and a general lack of transparency with respect to the availability of study data. Transparency in data analysis, increased statistical power, and more careful reporting of statistical outcomes are suggested to heighten methodological rigor and improve reproducibility in the field of VR research.
Year
DOI
Venue
2019
10.1016/j.chb.2019.06.015
Computers in Human Behavior
Keywords
DocType
Volume
Virtual reality,meta-Science,Statistical power,Questionable research practices,Quantitative methodology
Journal
100
ISSN
Citations 
PageRank 
0747-5632
1
0.36
References 
Authors
0
6
Name
Order
Citations
PageRank
Madison Lanier110.36
T. Franklin Waddell2295.10
Malte Elson363.07
Daniel J. Tamul410.36
James D. Ivory5193.83
Andrew K. Przybylski6987.90