Title | ||
---|---|---|
TALP-UPC at TREC 2005: Experiments Using a Voting Scheme Among Three Heterogeneous QA Systems |
Abstract | ||
---|---|---|
This paper describes the experiments of the TALP- UPC group for factoid and 'other' (definitional) ques- tions at TREC 2005 Main Question Answering (QA) task. Our current approach for factoid questions is based on a voting scheme among three QA sys- tems: TALP-QA (our previous QA system), Sibyl (a new QA system developed at DAMA-UPC and TALP-UPC), and Aranea (a web-based data-driven approach). For defitional questions, we used two dif- ferent systems: the TALP-QA Definitional system and LCSUM (a Summarization-based system). Our results for factoid questions indicate that the voting strategy improves the accuracy from 7.5% to 17.1%. While these numbers are low (due to technical problems in the Answer Extraction phase of TALP- QA system) they indicate that voting is a succesful approach for performance boosting of QA systems. The answer to definitional questions is produced by selecting phrases using set of patterns associated with definitions. Its results are 17.2% of F-score in the best configuration of TALP-QA Definitional system. |
Year | Venue | Keywords |
---|---|---|
2005 | TREC | question answering |
Field | DocType | Citations |
Data mining,Automatic summarization,Question answering,Information retrieval,Voting,Computer science,Boosting (machine learning),Factoid | Conference | 2 |
PageRank | References | Authors |
0.41 | 13 | 9 |
Name | Order | Citations | PageRank |
---|---|---|---|
Daniel Ferrés | 1 | 79 | 14.02 |
Samir Kanaan | 2 | 30 | 3.26 |
David Dominguez-Sal | 3 | 189 | 16.35 |
Edgar Gonzàlez | 4 | 39 | 4.82 |
Alicia Ageno | 5 | 150 | 15.77 |
María Fuentes Fort | 6 | 8 | 2.59 |
Horacio Rodríguez | 7 | 64 | 12.28 |
Mihai Surdeanu | 8 | 2582 | 174.69 |
Jordi Turmo | 9 | 306 | 30.52 |