Title
Using textual analysis with concept inventories to identify root causes of misconceptions
Abstract
Engineers must have deep and accurate conceptual understanding of their field and Concept inventories (CIs) are one method of assessing conceptual understanding and providing formative feedback. Current CI tests use Multiple Choice Questions (MCQ) to identify misconceptions and have undergone reliability and validity testing to assess conceptual understanding. However, they do not readily provide the diagnostic information about students' reasoning and therefore do not effectively point to specific actions that can be taken to improve student learning. We piloted the textual component of our diagnostic CI on electrical engineering students using items from the signals and systems CI. We then analysed the textual responses using automated lexical analysis software to test the effectiveness of these types of software and interviewed the students regarding their experience using the textual component. Results from the automated text analysis revealed that students held both incorrect and correct ideas for certain conceptual areas and provided indications of student misconceptions. User feedback also revealed that the inclusion of the textual component is helpful to students in assessing and reflecting on their own understanding.
Year
DOI
Venue
2014
10.1109/FIE.2014.7043999
FIE
Keywords
Field
DocType
computer aided instruction,educational courses,electrical engineering computing,electrical engineering education,text analysis,ci tests,mcq,automated lexical analysis software,automated text analysis,concept inventories,conceptual understanding,electrical engineering students,engineers,formative feedback,misconceptions root causes,multiple choice questions,reliability testing,student learning,textual analysis,textual responses,user feedback,validity testing,formative assessment,telecommunications engineering
Computer science,Knowledge management,Telecommunications engineering,Software,Mathematics education,Lexical analysis,Student learning,Formative assessment,Multiple choice
Conference
ISSN
Citations 
PageRank 
0190-5848
1
0.57
References 
Authors
0
3
Name
Order
Citations
PageRank
Andrea M. Goncher152.50
Wageeh W. Boles215519.82
Dhammika Jayalath319720.50