Abstract | ||
---|---|---|
This paper reports on the authors' experience in developing and running a distributed system for Web search and search-based document placement (advertising). Distributed architecture was chosen to address scalability issues and to provide seamless search service for the 'invisible Web'. The system consists of topical document collections and request routing infrastructure. Request routing to the appropriate document collection is performed for both search and placement requests. Other fea- tures of the system include support for structured attribute-based search, topic-specific (focused) Web crawling, and payment transactions. Security issues arising from the distributed nature of the system as well as from revenue generation are discussed. Important architectural and design decisions are presented and analysed in the light of implementation and pilot operation of the system. |
Year | Venue | Keywords |
---|---|---|
2005 | iiWAS | distributed architecture,distributed system,web crawling |
Field | DocType | Citations |
Web design,Middleware (distributed applications),World Wide Web,Advertising,Computer science,Distributed System Security Architecture,Distributed design patterns,Data Web,Distributed algorithm,Web crawler,Distributed web crawling | Conference | 1 |
PageRank | References | Authors |
0.39 | 17 | 2 |
Name | Order | Citations | PageRank |
---|---|---|---|
Nikita Schmidt | 1 | 335 | 18.25 |
Ahmed Patel | 2 | 167 | 23.33 |