Title
A hybrid distributed architecture for indexing
Abstract
This paper presents a hybrid scavenger grid as an underlying hardware architecture for search services within digital libraries. The hybrid scavenger grid consists of both dedicated servers and dynamic resources in the form of idle workstations to handle medium-to large-scale search engine workloads. The dedicated resources are expected to have reliable and predictable behaviour. The dynamic resources are used opportunistically without any guarantees of availability. Test results confirmed that indexing performance is directly related to the size of the hybrid grid and intranet networking does not play a major role. A system-efficiency and cost-effectiveness comparison of a grid and a multiprocessor machine showed that for workloads of modest to large sizes, the grid architecture delivers better throughput per unit cost than the multiprocessor, at a system efficiency that is comparable to that of the multiprocessor.
Year
DOI
Venue
2009
10.1007/978-3-642-04346-8_25
ECDL3
Keywords
Field
DocType
underlying hardware architecture,search service,grid architecture,dedicated resource,hybrid grid,dynamic resource,dedicated server,hybrid scavenger grid,medium-to large-scale search engine,multiprocessor machine,search engine,indexation,digital library,hardware architecture,cost effectiveness,distributed architecture
World Wide Web,Search engine,Computer science,Intranet,Server,Search engine indexing,Multiprocessing,Throughput,Grid,Distributed computing,Hardware architecture
Conference
Volume
ISSN
ISBN
5714
0302-9743
3-642-04345-3
Citations 
PageRank 
References 
1
0.35
8
Authors
2
Name
Order
Citations
PageRank
Ndapandula Nakashole139419.48
Hussein , Suleman217040.89