Paper Info
Title
Is it worth submitting this run?: assess your RTE system with a good sparring partner
Abstract
We address two issues related to the development of systems for Recognizing Textual Entailment. The first is the impossibility to capitalize on lessons learned over the different datasets available, due to the changing nature of traditional RTE evaluation settings. The second is the lack of simple ways to assess the results achieved by our system on a given training corpus, and figure out its real potential on unseen test data. Our contribution is the extension of an open-source RTE package with an automatic way to explore the large search space of possible configurations, in order to select the most promising one over a given dataset. From the developers' point of view, the efficiency and ease of use of the system, together with the good results achieved on all previous RTE datasets, represent a useful support, providing an immediate term of comparison to position the results of their approach.
Year
Venue
Keywords
2011
TextInfer@EMNLP
large search space,recognizing textual entailment,different datasets,open-source rte package,possible configuration,rte system,previous rte datasets,good sparring partner,traditional rte evaluation setting,real potential,immediate term,good result
Field
DocType
Volume
Textual entailment,Computer science,Usability,Impossibility,Artificial intelligence,Test data,Machine learning
Conference
W11-24
Citations 
PageRank 
References 
5
0.57
8
Authors
3
Name
Order
Citations
PageRank
Milen Kouylekov125429.43
Yashar Mehdad251432.04
Matteo Negri377582.49