Title
What is in the KGQA Benchmark Datasets? Survey on Challenges in Datasets for Question Answering on Knowledge Graphs
Abstract
Question Answering based on Knowledge Graphs (KGQA) still faces difficult challenges when transforming natural language (NL) to SPARQL queries. Simple questions only referring to one triple are answerable by most QA systems, but more complex questions requiring complex queries containing subqueries or several functions are still a tough challenge within this field of research. Evaluation results of QA systems therefore also might depend on the benchmark dataset the system has been tested on. For the purpose to give an overview and reveal specific characteristics, we examined currently available KGQA datasets regarding several challenging aspects. This paper presents a detailed look into the datasets and compares them in terms of challenges a KGQA system is facing.
Year
DOI
Venue
2021
10.1007/s13740-021-00128-9
Journal on Data Semantics
Keywords
DocType
Volume
Question answering on knowledge graphs, Dataset analysis, Natural language transformation, Pattern recognition
Journal
10
Issue
ISSN
Citations 
3
1861-2032
1
PageRank 
References 
Authors
0.37
0
2
Name
Order
Citations
PageRank
Nadine Steinmetz110.37
Kai-uwe Sattler21144126.81