Paper Info
Title
A Novel Technique for Automated Linguistic Quality Assessment of Students' Essays Using Automatic Summarizers
Abstract
In this paper, experiments have addressed the calculation of inter-annotator inconsistency in selecting the content in both manual and automatic summarization of sample TOEFL essays. A new finding is that the linguistic quality of source essay has a very strong correlation with the degree of disagreement among human assessors to what should be included in a summary. This leads to a fully automated essay evaluation technique based on degree of disagreement among automated summarizes. ROUGE evaluation is used to measure the degree of inconsistency among the participants (human summarizers and automatic summarizers). This automated essay evaluation technique is potentially an important contribution with wider significance.
Year
DOI
Venue
2009
10.1109/CSIE.2009.777
CSIE
Keywords
Field
DocType
document handling,linguistics,text analysis,ROUGE evaluation,TOEFL essays,automated linguistic quality assessment,automatic summarizers,fully automated essay evaluation technique,human summarizers,inconsistency degree,Automatic Summarization,ROUGE Evaluation,Summarization Evaluation
Automatic summarization,Automated essay evaluation,Information retrieval,Computer science,Test of English as a Foreign Language,Artificial intelligence,Atmospheric measurements,Natural language processing,Document handling,Linguistics
Conference
Volume
Citations 
PageRank 
5
1
0.38
References 
Authors
4
2
Name
Order
Citations
PageRank
Seemab Latif1275.71
Mary McGee Wood26811.69