Paper Info
Title
Automatic performance evaluation of web search engines
Abstract
Measuring the information retrieval effectiveness of World Wide Web search engines is costly because of human relevance judgments involved. However, both for business enterprises and people it is important to know the most effective Web search engines, since such search engines help their users find higher number of relevant Web pages with less effort. Furthermore, this information can be used for several practical purposes. In this study we introduce automatic Web search engine evaluation method as an efficient and effective assessment tool of such systems. The experiments based on eight Web search engines, 25 queries, and binary user relevance judgments show that our method provides results consistent with human-based evaluations. It is shown that the observed consistencies are statistically significant. This indicates that the new method can be successfully used in the evaluation of Web search engines.
Year
DOI
Venue
2004
10.1016/S0306-4573(03)00040-2
Inf. Process. Manage.
Keywords
Field
DocType
information retrieval,evaluation method,world wide web,automatic performance evaluation,search engine,relevant web page,effective assessment tool,world wide web search,web search engine,performance,effective web search engine,new method,binary user relevance judgment,automatic web search engine,statistical significance,web pages
Web design,Web search engine,Data mining,Web search query,Metasearch engine,World Wide Web,Semantic search,Information retrieval,Web page,Computer science,Web modeling,Search analytics
Journal
Volume
Issue
ISSN
40
3
Information Processing and Management
Citations 
PageRank 
References 
29
1.84
14
Authors
3
Name
Order
Citations
PageRank
Fazli Can158194.63
Rabia Nuray21197.12
Ayisigi B. Sevdik3292.18