Title | ||
---|---|---|
Infrastructure and workflow for the formal evaluation of semantic search technologies |
Abstract | ||
---|---|---|
This paper describes an infrastructure for the automated evaluation of semantic technologies and, in particular, semantic search technologies. For this purpose, we present an evaluation framework which follows a service-oriented approach for evaluating semantic technologies and uses the Business Process Execution Language (BPEL) to define evaluation workflows that can be executed by process engines. This framework supports a variety of evaluations, from different semantic areas, including search, and is extendible to new evaluations. We show how BPEL addresses this diversity as well as how it is used to solve specific challenges such as heterogeneity, error handling and reuse. |
Year | DOI | Venue |
---|---|---|
2011 | 10.1145/2064227.2064257 | Proceedings of the 2011 workshop on Data infrastructurEs for supporting information retrieval evaluation |
Keywords | DocType | Citations |
evaluation workflows,process engine,different semantic area,new evaluation,error handling,automated evaluation,evaluation framework,semantic technology,semantic search technology,business process execution language,formal evaluation,process engineering,bpel,semantic search,semantic technologies,workflows | Conference | 2 |
PageRank | References | Authors |
0.38 | 8 | 3 |
Name | Order | Citations | PageRank |
---|---|---|---|
Stuart N. Wrigley | 1 | 181 | 20.56 |
Raul Garcia-Castro | 2 | 527 | 56.11 |
Cássia Trojahn | 3 | 158 | 12.21 |