Name
Title | ||
|---|---|---|
Are open-domain question answering technologies useful for information access dialogues?---an empirical study and a proposal of a novel challenge |
Abstract | ||
|---|---|---|
There are strong expectations for the use of question answering technologies in information access dialogues, such as for information gathering and browsing. In this paper, we empirically examine what kinds of abilities are needed for question answering systems in such situations, and propose a challenge for evaluating those abilities objectively and quantitatively. We also show that existing technologies have the potential to address this challenge. From the empirical study, we found that questions that have values and names as answers account for a majority in realistic information-gathering situations and that those sequences of questions contain a wide range of reference expressions and are sometimes complicated by the inclusion of subdialogues and focus shifts. The challenge proposed is not only novel as an evaluation of the handling of information access dialogues, but also includes several valuable ideas such as categorization and characterization of information access dialogues, and introduces three measures to evaluate various aspects in addressing list-type questions and reference test sets for evaluating context-processing ability in isolation. |
Year | DOI | Venue |
|---|---|---|
2005 | 10.1145/1111667.1111669 | ACM Trans. Asian Lang. Inf. Process. |
Keywords | Field | DocType |
question answering technology,context-processing ability,focus shift,open-domain question answering technology,novel challenge,empirical study,question answering system,evaluation,list-type question,reference test set,information access dialogue,information gathering,question answering,reference expression | Categorization,Question answering,Expression (mathematics),Information retrieval,Computer science,Information access,Empirical research | Journal |
Volume | Issue | Citations |
4 | 3 | 7 |
PageRank | References | Authors |
0.69 | 5 | 4 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Tsuneaki Kato | 1 | 271 | 38.70 |
| Jun'ichi Fukumoto | 2 | 11 | 1.86 |
| Fumito Masui | 3 | 87 | 27.22 |
| Noriko Kando | 4 | 1474 | 209.89 |