Name
Title | ||
|---|---|---|
Similarity and duplicate detection system for an OAI compliant federated digital library |
Abstract | ||
|---|---|---|
The Open Archives Initiative (OAI) is making feasible to build high level services such as a federated search service that harvests metadata from different data providers using the OAI protocol for metadata harvesting (OAI-PMH) and provides a unified search interface. There are numerous challenges to build and maintain a federation service, and one of them is managing duplicates. Detecting exact duplicates where two records have identical set of metadata fields is straight-forward. The problem arises when two or more records differ slightly due to data entry errors, for example. Many duplicate detection algorithms exist, but are computationally intensive for large federated digital library. In this paper, we propose an efficient duplication detection algorithm for a large federated digital library like Arc. |
Year | DOI | Venue |
|---|---|---|
2005 | 10.1007/11551362_68 | ECDL3 |
Keywords | Field | DocType |
different data provider,federated search service,metadata field,detection system,oai compliant,efficient duplication detection algorithm,duplicate detection algorithm,harvests metadata,data entry error,metadata harvesting,oai protocol,large federated digital library,digital library | Similitude,Open Archives Initiative,Metadata,Protocol for Metadata Harvesting,Duplicate detection,World Wide Web,Federated search,Information retrieval,Computer science,Data entry,Digital library,Database | Conference |
Volume | ISSN | ISBN |
3652 | 0302-9743 | 3-540-28767-1 |
Citations | PageRank | References |
1 | 0.35 | 3 |
Authors | ||
3 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Haseebulla M. Khan | 1 | 1 | 0.35 |
| Kurt Maly | 2 | 567 | 139.93 |
| Mohammad Zubair | 3 | 587 | 89.90 |