Title
Analyzing rich qualitative data to study pencil-puzzle-based assignments in CS1 and CS2.
Abstract
Pencil puzzles (puzzles such as sudoku and many others that are designed to be solved by humans, promoting computational thinking) provide a natural context for CS1/2 assignments. In a prior work we analyzed Likert-scaled student responses and assignment/course grades to show that not only are such assignments effective but are also largely independent of gender and prior computing experience. This paper focuses on open-ended student comments, both to see if they provide additional insights about the assignments and student perceptions not apparent from the Likert-scaled responses, and to see if these comments are consistent with the results from the prior work. We surveyed over 1000 students who had used pencil-puzzle-based assignments and invited them to make open-ended comments in their survey responses. We used grounded theory to develop codes for the large volume of student survey comments, as well as for semi-structured interviews with the instructors and focus groups with student TAs. Statistical analysis of the coded comments identified several interesting relationships, such as students being appreciative of their learning even when they perceived the assignments as difficult, which were not available from the Likert-scaled data. The analysis also confirmed that these assignments are largely gender- and experience-neutral. We conclude by discussing how these results and the coding process lead to improvements in assignment development and inform future research directions.
Year
DOI
Venue
2018
10.1145/3197091.3197109
ITiCSE
Keywords
Field
DocType
Introductory computer science, qualitative analysis, puzzles
Grounded theory,Qualitative property,Computer science,Computational thinking,Knowledge management,Coding (social sciences),Mathematics education,Pencil (mathematics),Perception,Focus group,Statistical analysis
Conference
ISBN
Citations 
PageRank 
978-1-4503-5707-4
0
0.34
References 
Authors
6
3
Name
Order
Citations
PageRank
Zack Butler124.41
Ivona Bezáková203.72
Kimberly Fluet300.34