Title
Towards a Quantitative, Platform-Independent Analysis of Knowledge Systems
Abstract
The Halo Pilot, a six-month effort to evaluate the state-of- the-art in applied Knowledge Representation and Reasoning (KRR) systems, collaboratively developed a taxonomy of failures with the goal of creating a common framework of metrics against which we could measure inter- and intra- system failure characteristics of each of the three Halo knowledge applications. This platform independent taxonomy was designed with the intent of maximizing its coverage of potential failure types; providing the necessary granularity and precision to enable clear categorization of failure types; and providing a productive framework for short and longer term corrective action. Examining the failure analysis and initial empirical use of the taxonomy provides quantitative insights into the strengths and weaknesses of individual systems and raises some issues shared by all three. These results are particularly interesting when considered against the long history of assumed reasons for knowledge system failure. Our study has also uncovered some shortcomings in the taxonomy itself, implying the need to improve both its granularity and precision. It is the hope of Project Halo to eventually produce a failure taxonomy and associated methodology that will be of general use in the fine-grained analysis of knowledge systems.
Year
Venue
DocType
2004
KR
Conference
Citations 
PageRank 
References 
7
2.04
9
Authors
13
Name
Order
Citations
PageRank
Noah S. Friedland1507.15
Paul G. Allen2415.83
Michael J. Witbrock336055.04
Gavin Matthews4415.83
Nancy Salay5204.57
Pierluigi Miraglia6598.21
Jürgen Angele79318.43
Steffen Staab86658593.89
David J. Israel9961291.98
Vinay K. Chaudhri10587246.49
Bruce W. Porter1122358.67
Ken Barker1283483.23
Peter Clark1378072.67