Name
Title | ||
|---|---|---|
Question Answering Challenge (QAC-1): An Evaluation of Question Answering Tasks at the NTCIR Workshop 3 |
Abstract | ||
|---|---|---|
Abstract In this paper we describe the Question Answering Chal- lenge (QAC), a question answering task, and its fir st evalu- ation (QAC1). The project was carried out as a task of the NTCIR Workshop 3 in October 2002. One objective of the QAC was to develop practical QA systems in a general do- main by focusing on research relating to user interaction and information extraction. Our second objective was to develop an evaluation method for the question answering system and information resources for evaluation. We defined three kinds of tasks in the QAC: Task 1, where questions required five possible answers;, Task 2, where questions had a single answer; and Task 3 ,where there was one answer to a question related to a question in Task 2. We prepared 200 questions for Task 1 and Task 2 and 40 ques- tions for Task 3 at the Formal Run and about 900 questions for the additional run. We conducted a Dry Run and a For- mal Run evaluation. There were 16 participants (two of them from among,the task organizers) at the QAC1. Keywords: Question Answering, Information Extraction, Information Retrieval, user interaction, evaluation tools |
Year | Venue | Keywords |
|---|---|---|
2003 | New Directions in Question Answering | information extraction,information retrieval,question answering system,question answering |
Field | DocType | Citations |
Dry run,Question answering,Information retrieval,Computer science,Information extraction | Conference | 20 |
PageRank | References | Authors |
3.50 | 3 | 3 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Junichi Fukumoto | 1 | 120 | 16.22 |
| Tsuneaki Kato | 2 | 271 | 38.70 |
| Fumito Masui | 3 | 87 | 27.22 |