Paper Info
Title
An Overview of NTCIR-5 QAC3
Abstract
This paper provides an overview of NTCIR-5 QAC3 (Question Answering Challenge 3). QAC is a series of challenges for evaluating question answering tech-nologies in Japanese. QAC3 follows the same course as QAC based on the success of the previous two work-shops, with its task limited to that corresponding to QAC2 Subtask 3 aiming at the convergence of research resources for novel subjects. This task assumes inter-active use of QA systems and evaluates, among other things, the abilities needed under such circumstances, i. e. proper interpretation of questions under a given dialogue context; in other words, context processing abilities such as anaphora resolution and ellipses han-dling (hereafter we refer to the task as the IAD task, where IAD stands for Information Access Dialogue, and to the whole workshop as QAC3). The IAD task in QAC3 is based on QAC2 Subtask 3 with several improvements, including elaboration of the scope of questions and answers and introduction of multi-grade evaluation and the concept of a correct answer set. In addition, a new WoZ method was devised and applied in the QAC3 test set construction. QAC3 had as many participants as QAC2 Subtask 3, and new trials and advances in existing methods were observed from the submission results.
Year
Venue
Field
2005
NTCIR
Convergence (routing),Question answering,Information retrieval,Computer science,Information access,Natural language processing,Artificial intelligence,Elaboration,Test set
DocType
Citations 
PageRank 
Conference
8
1.22
References 
Authors
14
2
Name
Order
Citations
PageRank
Tsuneaki Kato127138.70
Fumito Masui28727.22