Title
TALP-UPC at TREC 2005: Experiments Using a Voting Scheme Among Three Heterogeneous QA Systems
Abstract
This paper describes the experiments of the TALP- UPC group for factoid and 'other' (definitional) ques- tions at TREC 2005 Main Question Answering (QA) task. Our current approach for factoid questions is based on a voting scheme among three QA sys- tems: TALP-QA (our previous QA system), Sibyl (a new QA system developed at DAMA-UPC and TALP-UPC), and Aranea (a web-based data-driven approach). For defitional questions, we used two dif- ferent systems: the TALP-QA Definitional system and LCSUM (a Summarization-based system). Our results for factoid questions indicate that the voting strategy improves the accuracy from 7.5% to 17.1%. While these numbers are low (due to technical problems in the Answer Extraction phase of TALP- QA system) they indicate that voting is a succesful approach for performance boosting of QA systems. The answer to definitional questions is produced by selecting phrases using set of patterns associated with definitions. Its results are 17.2% of F-score in the best configuration of TALP-QA Definitional system.
Year
Venue
Keywords
2005
TREC
question answering
Field
DocType
Citations 
Data mining,Automatic summarization,Question answering,Information retrieval,Voting,Computer science,Boosting (machine learning),Factoid
Conference
2
PageRank 
References 
Authors
0.41
13
9
Name
Order
Citations
PageRank
Daniel Ferrés17914.02
Samir Kanaan2303.26
David Dominguez-Sal318916.35
Edgar Gonzàlez4394.82
Alicia Ageno515015.77
María Fuentes Fort682.59
Horacio Rodríguez76412.28
Mihai Surdeanu82582174.69
Jordi Turmo930630.52