Paper Info
Title
Evaluation of Google question-answering quality
Abstract
Purpose The purpose of this paper is to evaluate Google question-answering (QA) quality. Design/methodology/approach Given the large variety and complexity of Google answer boxes in search result pages, existing evaluation criteria for both search engines and QA systems seemed unsuitable. This study developed an evaluation criteria system for the evaluation of Google QA quality by coding and analyzing search results of questions from a representative question set. The study then evaluated Google's overall QA quality as well as QA quality across four target types and across six question types, using the newly developed criteria system. ANOVA and Tukey tests were used to compare QA quality among different target types and question types. Findings It was found that Google provided significantly higher-quality answers to person-related questions than to thing-related, event-related and organization-related questions. Google also provided significantly higher-quality answers to where- questions than to who-, what- and how-questions. The more specific a question is, the higher the QA quality would be. Originality/value Particularly suitable for search engine QA quality analysis, the newly developed evaluation criteria system expanded and enriched assessment metrics of both search engines and QA systems.
Year
DOI
Venue
2019
10.1108/LHT-10-2017-0218
LIBRARY HI TECH
Keywords
Field
DocType
Google,Search engine,Evaluation criteria,Question-answering,Question type,Target type
User experience design,World Wide Web,Question answering,Search engine,Computer science,Coding (social sciences)
Journal
Volume
Issue
ISSN
37.0
2.0
0737-8831
Citations 
PageRank 
References 
0
0.34
11
Authors
4
Name
Order
Citations
PageRank
Yiming Zhao1105.23
Jin Zhang243.84
Xue Xia300.34
Taowen Le4153.33