Title
Validating Items Of Different Modalities To Assess The Educational Technology Competency Of Pre-Service Teachers
Abstract
With increasingly more educational tests being administered on computers and other digital devices, the comprehensive validity of tests has more potential to be improved. In the present investigation, 75 items were developed to measure educational technology competency (ETC) for pre-service teachers according to a framework constructed using the Delphi technique. In particular, the appropriateness of items was tested using the multitrait-multimethod (MTMM), higher-order factor model, and multidimensional item response theory (MIRT) to shape a program for developing and validating different modality items. The results were as follows: (1) There was robust convergent validity, weak discriminant validity, and an evident method effect of the items. (2) The graphic modality might explain more variance than the text and video modalities at discriminating examinees' ETC proficiencies. (3) The graphic modality was the most reliable modality among the three different modalities when assessing technology-supported teaching. Thus, this study makes a significant contribution to the design of assessments by developing and validating different modality items. The results could be generalized to some extent when items are developed based on other ETC standards.
Year
DOI
Venue
2021
10.1016/j.compedu.2020.104081
COMPUTERS & EDUCATION
Keywords
DocType
Volume
Evaluation methodologies, Post-secondary education, Teacher professional development, Architectures for educational technology system
Journal
162
ISSN
Citations 
PageRank 
0360-1315
0
0.34
References 
Authors
0
2
Name
Order
Citations
PageRank
Yue Wang111.03
Hong Lu2121.97