Paper Info
Title
A Systematic Investigation of Replications in Computing Education Research.
Abstract
As the societal demands for application and knowledge in computer science (CS) increase, CS student enrollment keeps growing rapidly around the world. By continuously improving the efficacy of computing education and providing guidelines for learning and teaching practice, computing education research plays a vital role in addressing both educational and societal challenges that emerge from the growth of CS students. Given the significant role of computing education research, it is important to ensure the reliability of studies in this field. The extent to which studies can be replicated in a field is one of the most important standards for reliability. Different fields have paid increasing attention to the replication rates of their studies, but the replication rate of computing education was never systematically studied. To fill this gap, this study investigated the replication rate of computing education between 2009 and 2018. We examined 2,269 published studies from three major conferences and two major journals in computing education, and found that the overall replication rate of computing education was 2.38%. This study demonstrated the need for more replication studies in computing education and discussed how to encourage replication studies through research initiatives and policy making.
Year
DOI
Venue
2019
10.1145/3345328
ACM Transactions on Computing Education
Keywords
Field
DocType
Computing education,assessment,computer science education,content analysis,educational policy,evaluation,replication rate,replications,research methodology
Content analysis,Computer science,Knowledge management,Research methodology
Journal
Volume
Issue
ISSN
19
4
1946-6226
Citations 
PageRank 
References 
0
0.34
0
Authors
5
Name
Order
Citations
PageRank
Qiang Hao101.01
David H. Smith IV200.34
Naitra Iriumi300.34
Michail Tsikerdekis4457.30
Andrew J. Ko52253141.88