Title
Inferential Statistics in Computing Education Research: A Methodological Review
Abstract
The goal of most computing education research is to effect positive change in how computing is taught and learned. Statistical techniques are one important tool for achieving this goal. In this paper we report on an analysis of ICER papers that use inferential statistics. We present the most commonly used techniques; an overview of the techniques the ICER community has used over its first 14 years of papers, grouped according to the purpose of the technique; and a detailed analysis of three of the most commonly used techniques (t-test, chi-squared test, and Mann-Whitney-Wilcoxon). We identify common flaws in reporting and give examples of papers where statistics are reported well. In sum, the paper draws a picture of the use of inferential statistics by the ICER community. This picture is intended to help orient researchers who are new to the use of statistics in computing education research and to encourage reflection by the ICER community on how it uses statistics and how it can improve that use.
Year
DOI
Venue
2019
10.1145/3291279.3339408
Proceedings of the 2019 ACM Conference on International Computing Education Research
Keywords
Field
DocType
alphabet soup, empirical research, methodology, reporting, statistical significance, statistics
Data science,Computer science,Knowledge management,Statistical inference,Empirical research
Conference
ISSN
ISBN
Citations 
978-1-4503-6185-9
978-1-4503-6185-9
0
PageRank 
References 
Authors
0.34
0
6
Name
Order
Citations
PageRank
Kate Sanders155655.54
Judy Sheard244460.95
Brett A. Becker39326.00
Anna Eckerdal429632.47
Sally Hamouda5566.14
Simon632040.39