Title
A Question-Answering System for AP Chemistry: Assessing KR&R Technologies
Abstract
Basic research in knowledge representation and reasoning (KR&R) has steadily advanced over the years, but it has been difficult to assess the capability of fielded systems derived from this research. In this paper, we present a knowledge-based question-answering system that we developed as part of a broader effort by Vulcan Inc. to assess KR&R technologies, and the result of its assessment. The challenge problem presented significant new challenges for knowledge representation, compared with earlier such assessments, due to the wide variability of question types that the system was expected to answer. Our solution integrated several modern KR&R technologies, in particular semantically well-defined frame systems, automatic classification methods, reusable ontologies, a methodology for knowledge base construction, and a novel extension of methods for explanation generation. The resulting system exhibited high performance, achieving scores for both accuracy and explanation which were comparable to human performance on similar tests. While there are qualifications to this result, it is a significant achievement and an informative data point about the state of the art in KR&R, and reflects significant progress by the field.
Year
Venue
Keywords
2004
KR
human performance,knowledge representation,question answering system,knowledge representation and reasoning,knowledge base
Field
DocType
Citations 
Ontology (information science),Data science,Knowledge representation and reasoning,Question answering,Computer science,Theoretical computer science,Artificial intelligence,Knowledge base,Basic research
Conference
25
PageRank 
References 
Authors
2.25
18
11
Name
Order
Citations
PageRank
Ken Barker183483.23
Vinay K. Chaudhri2587246.49
Shaw Yi Chaw314212.39
Peter Clark478072.67
James Fan585150.94
David J. Israel6961291.98
Sunil Mishra716213.01
Bruce W. Porter8252.25
Pedro Romero97610.73
dan g tecuci1013112.84
Peter Z. Yeh1138028.42