Title
Automatic detection of student mental models based on natural language student input during metacognitive skill training
Abstract
This article describes the problem of detecting the student mental models, i.e. students' knowledge states, during the self-regulatory activity of prior knowledge activation in MetaTutor, an intelligent tutoring system that teaches students self-regulation skills while learning complex science topics. The article presents several approaches to automatically detecting students' mental models in MetaTutor based on paragraphs generated by students during prior knowledge activation. Three major categories of methods (content-based overlap methods; cohesion analysis of text; and tf-idf based weighted representations) were developed and combined with machine learning algorithms in order to automatically infer the underlying parameters. A detailed comparison among the methods and across all machine learning algorithms is provided. The evaluation of the proposed methods is performed by eomparing the methods' predictions with human judgments on a set of 309 prior knowledge activation paragraphs collected from experiments with the MetaTutor system on college students. According to the experiments, a word-weighting method, which uses tf-idf values calculated from the corpus, combined with a Bayes Nets machine learning algorithm, offers the most accurate results. Second best performance is given by a Latent Semantic Analysis-based approach enhanced with lexical features and combined with the machine learning algorithm of Logistic Regression.
Year
DOI
Venue
2012
10.3233/JAI-2012-022
I. J. Artificial Intelligence in Education
Keywords
Field
DocType
automatic detection,student mental model,tf-idf value,prior knowledge activation,intelligent tutoring system,metacognitive skill training,latent semantic analysis-based approach,bayes nets machine,students self-regulation skill,metatutor system,natural language student input,knowledge state,mental model,mathematics,comparative analysis,latent semantic indexing,metacognition,prediction,natural language processing,semantics
Cohesion (chemistry),Intelligent tutoring system,Computer science,Metacognition,Natural language,Natural language processing,Artificial intelligence,Latent semantic analysis,Logistic regression,Machine learning,Semantics,Bayes' theorem
Journal
Volume
Issue
Citations 
21
3
6
PageRank 
References 
Authors
0.69
13
3
Name
Order
Citations
PageRank
Mihai Lintean1987.73
Vasile Rus2973134.69
Roger Azevedo312724.65