Paper Info
Title
Comparison of Methods for Evaluating Complexity of Simplified Texts among Deaf and Hard-of-Hearing Adults at Different Literacy Levels
Abstract
ABSTRACT Research has explored using Automatic Text Simplification for reading assistance, with prior work identifying benefits and interests from Deaf and Hard-of-Hearing (DHH) adults. While the evaluation of these technologies remains a crucial aspect of research in the area, researchers lack guidance in terms of how to evaluate text complexity with DHH readers. Thus, in this work we conduct methodological research to evaluate metrics identified from prior work (including reading speed, comprehension questions, and subjective judgements of understandability and readability) in terms of their effectiveness for evaluating texts modified to be at various complexity levels with DHH adults at different literacy levels. Subjective metrics and low-linguistic-complexity comprehension questions distinguished certain text complexity levels with participants with lower literacy. Among participants with higher literacy, only subjective judgements of text readability distinguished certain text complexity levels. For all metrics, participants with higher literacy scored higher or provided more positive subjective judgements overall.
Year
DOI
Venue
2021
10.1145/3411764.3445038
Conference on Human Factors in Computing Systems
Keywords
DocType
Citations 
Automatic Text Simplifcation, Methodological Research, Deaf and Hard-of-hearing, Accessibility
Conference
0
PageRank 
References 
Authors
0.34
0
4
Name
Order
Citations
PageRank
Oliver Alonzo101.35
Jessica Trussell200.34
Becca Dingman313.07
Matt Huenerfauth442851.83