Paper Info
Title
DP9: an OAI gateway service for web crawlers
Abstract
Many libraries and databases are closed to general-purpose Web crawlers, and they expose their content only through their own search engines. At the same time many researchers attempt to locate technical papers through general-purpose Web search engines. DP9 is an open source gateway service that allows general search engines, (e.g. Google, Inktomi) to index OAI-compliant archives. DP9 does this by providing consistent URLs for repository records, and converting them to OAI queries against the appropriate repository when the URL is requested. This allows search engines that do not support the OAI protocol to index the "deep Web" contained within OAI compliant repositories.
Year
DOI
Venue
2002
10.1145/544220.544284
JCDL
Keywords
Field
DocType
oai query,deep web,oai gateway service,general-purpose web crawler,own search engine,web crawler,appropriate repository,oai compliant repository,general-purpose web search engine,search engine,general search engine,oai protocol,indexation,web search engine
Web search engine,Open Archives Initiative,Web search query,World Wide Web,Site map,Web page,Information retrieval,Computer science,Data Web,Web service,Web crawler
Conference
ISBN
Citations 
PageRank 
1-58113-513-0
11
1.30
References 
Authors
3
4
Name
Order
Citations
PageRank
Xiaoming Liu146139.13
Kurt Maly2567139.93
Mohammad Zubair358789.90
Michael L. Nelson41458198.74