Title
The Qanary Ecosystem: Getting New Insights by Composing Question Answering Pipelines.
Abstract
The field of Question Answering (QA) is very multi-disciplinary as it requires expertise from a large number of areas such as natural language processing (NLP), artificial intelligence, machine learning, information retrieval, speech recognition and semantic technologies. In the past years a large number of QA systems were proposed using approaches from different fields and focusing on particular tasks in the QA process. Unfortunately, most of these systems cannot be easily reused, extended, and results cannot be easily reproduced since the systems are mostly implemented in a monolithic fashion, lack standardized interfaces and are often not open source or available as Web services. To address these issues we developed the knowledge-based Qanary methodology for choreographing QA pipelines distributed over the Web. Qanary employs the qa vocabulary as an exchange format for typical QA components. As a result, QA systems can be built using the Qanary methodology in a simpler, more flexible and standardized way while becoming knowledge-driven instead of being process-oriented. This paper presents the components and services that are integrated using the qa vocabulary and the Qanary methodology within the Qanary ecosystem. Moreover, we show how the Qanary ecosystem can be used to analyse QA processes to detect weaknesses and research gaps. We illustrate this by focusing on the Entity Linking (EL) task w.r.t. textual natural language input, which is a fundamental step in most QA processes. Additionally, we contribute the first EL benchmark for QA, as open source. Our main goal is to show how the research community can use Qanary to gain new insights into QA processes.
Year
Venue
Field
2017
ICWE
Ontology (information science),Entity linking,Data mining,World Wide Web,Question answering,Semantic search,Computer science,Semantic Web,Natural language,Web service,Vocabulary
DocType
Citations 
PageRank 
Conference
7
0.49
References 
Authors
14
6
Name
Order
Citations
PageRank
Dennis Diefenbach18410.47
Kuldeep Singh2224.15
Andreas Both336830.03
Didier Cherix41154.36
Christoph Lange524235.49
Sören Auer65711418.56