Paper Info
Title
Scalability and efficiency challenges in commercial web search engines
Abstract
Commercial web search engines rely on very large compute infrastructures to be able to cope with the continuous growth of the Web and user bases. Achieving scalability and efficiency in such large-scale search engines requires making careful architectural design choices while devising algorithmic performance optimizations. Unfortunately, most details about the internal functioning of commercial web search engines remain undisclosed due to their financial value and the high level of competition in the search market. The main objective of this tutorial is to provide an overview of the fundamental scalability and efficiency challenges in commercial web search engines, bridging the existing gap between the industry and academia.
Year
DOI
Venue
2013
10.1145/2484028.2484189
SIGIR
Keywords
Field
DocType
continuous growth,large-scale search engine,commercial web search engine,careful architectural design choice,fundamental scalability,algorithmic performance optimizations,efficiency challenge,existing gap,achieving scalability,search market,scalability,crawling,indexing,efficiency
Data science,World Wide Web,Search engine,Crawling,Architectural design,Query expansion,Information retrieval,Computer science,Bridging (networking),Search engine indexing,Web modeling,Scalability
Conference
Citations 
PageRank 
References 
2
0.54
2
Authors
2
Name
Order
Citations
PageRank
B. Barla Cambazoglu173538.87
Ricardo Baeza-Yates26173635.97