Title
Methods for Evaluating Simulated Learners: Examples from SimStudent.
Abstract
We discuss methods for evaluating simulated learners associated with four different scientific and practical goals for simulated learners. These goals are to develop a precise theory of learning, to provide a formative test of alternative instructional approaches, to automate authoring of intelligent tutoring systems, and to use as a teachable agent for students to learn by teaching. For each goal, we discuss methods for evaluating how well a simulated learner achieves that goal. We use SimStudent, a simulated learner theory and software architecture, to illustrate these evaluation methods. We describe, for example, how SimStudent has been evaluated as a theory of student learning by comparing, across four domains, the cognitive models it learns to the hand-authored models. The SimStudent-acquired models generally yield more accurate predictions of student data. We suggest future research into directly evaluating simulated learner predictions of the process of student learning.
Year
Venue
Field
2015
AIED Workshops
Computer science,Learning theory,Human–computer interaction,Software architecture,Cognition,Formative assessment,Student learning
DocType
Citations 
PageRank 
Conference
3
0.43
References 
Authors
8
4
Name
Order
Citations
PageRank
Kenneth R. Koedinger13551403.07
Noboru Matsuda220023.45
Christopher J. MacLellan3409.84
Elizabeth A. McLaughlin414711.51