Name
Abstract | ||
|---|---|---|
Traditional tools for information retrieval (IR) evaluation, such as TREC's trec_eval, have outdated command-line interfaces with many unused features, or 'switches', accumulated over the years. They are usually seen as cumbersome applications by new IR researchers, steepening the learning curve. We introduce a platform-independent application for IR evaluation with a graphical easy-to-use interface: the TREC_Files Evaluator. The application supports most of the standard measures used for evaluation in TREC, CLEF, and elsewhere, such as MAP, P10, P20, and bpref, as well as the Averaged Normalized Modified Retrieval Rank (ANMRR) proposed by MPEG for image retrieval evaluation. Additional features include a batch mode and statistical significance testing of the results against a pre-selected baseline. |
Year | DOI | Venue |
|---|---|---|
2011 | 10.1145/2009916.2010164 | SIGIR |
Keywords | DocType | Citations |
image retrieval evaluation,information retrieval,trec file,new ir researcher,batch mode,trec_files evaluator,platform-independent application,ir evaluation,averaged normalized modified retrieval,cumbersome application,additional feature,image retrieval,evaluation,learning curve,ground truth,statistical significance,command line interface | Conference | 6 |
PageRank | References | Authors |
0.62 | 0 | 3 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Savvas A. Chatzichristofis | 1 | 810 | 44.88 |
| Konstantinos Zagoris | 2 | 231 | 17.12 |
| Avi Arampatzis | 3 | 443 | 39.38 |