Paper Info
Title
Model-based Testing of Scratch Programs
Abstract
Learners are often introduced to programming via dedicated languages such as SCRATCH, where block-based commands are assembled visually in order to control the interactions of graphical sprites. Automated testing of such programs is an important prerequisite for supporting debugging, providing hints, or assessing learning outcomes. However, writing tests for SCRATCH programs can be challenging: The game-like and randomised nature of typical SCRATCH programs makes it difficult to identify specific timed input sequences used to control the programs. Furthermore, precise test assertions to check the resulting program states are incompatible with the fundamental principle of creative freedom in programming in SCRATCH, where correct program behaviour may be implemented with deviations in the graphical appearance or timing of the program. The event-driven and actor-oriented nature of SCRATCH programs, however, makes them a natural fit for describing program behaviour using finite state machines. In this paper, we introduce a model-based testing approach by extending WHISKER, an automated testing framework for SCRATCH programs. The model-based extension describes expected program behaviour in terms of state machines, which makes it feasible to check the abstract behaviour of a program independent of exact timing and pixel-precise graphical details, and to automatically derive test inputs testing even challenging programs. A video demonstrating model-based testing with WHISKER is available at the following URL: https://youtu.be/edgCNbGSGEY
Year
DOI
Venue
2022
10.1109/ICST53961.2022.00047
2022 IEEE Conference on Software Testing, Verification and Validation (ICST)
Keywords
DocType
ISSN
Model-based Testing,Scratch,GUI Testing
Conference
2159-4848
ISBN
Citations 
PageRank 
978-1-6654-6680-6
0
0.34
References 
Authors
12
3
Name
Order
Citations
PageRank
Katharina Götz100.34
Patric Feldmeier200.34
Gordon Fraser32625116.22