Title
Integrating LSA-based hierarchical conceptual space and machine learning methods for leveling the readability of domain-specific texts
Abstract
Text readability assessment is a challenging interdisciplinary endeavor with rich practical implications. It has long drawn the attention of researchers internationally, and the readability models since developed have been widely applied to various fields. Previous readability models have only made use of linguistic features employed for general text analysis and have not been sufficiently accurate when used to gauge domain-specific texts. In view of this, this study proposes a latent-semantic-analysis (LSA)-constructed hierarchical conceptual space that can be used to train a readability model to accurately assess domain-specific texts. Compared with a baseline reference using a traditional model, the new model improves by 13.88% to achieve 68.98% of accuracy when leveling social science texts, and by 24.61% to achieve 73.96% of accuracy when assessing natural science texts. We then combine the readability features developed for the current study with general linguistic features, and the accuracy of leveling social science texts improves by an even higher degree of 31.58% to achieve 86.68%, and that of natural science texts by 26.56% to achieve 75.91%. These results indicate that the readability features developed in this study can be used both to train a readability model for leveling domain-specific texts and also in combination with the more common linguistic features to enhance the efficacy of the model. Future research can expand the generalizability of the model by assessing texts from different fields and grade levels using the proposed method, thus enhancing the practical applications of this new method.
Year
DOI
Venue
2019
10.1017/S1351324919000093
NATURAL LANGUAGE ENGINEERING
Keywords
Field
DocType
Domain-specific text,Machine learning,Readability,Support vector machine,Text mining
Text mining,Computer science,Support vector machine,Conceptual space,Readability,Artificial intelligence,Natural language processing
Journal
Volume
Issue
ISSN
25
3.0
1351-3249
Citations 
PageRank 
References 
0
0.34
0
Authors
4
Name
Order
Citations
PageRank
Hou-Chiang Tseng132.53
Berlin Chen215134.59
Tao-Hsing Chang36910.11
Yao Ting Sung462264.23