Title
Automated Building of OAI Compliant Repository from Legacy Collection
Abstract
In this paper, we report on our experience with the creation of an automated, human-assisted process to extract metadata from documents in a large (>100,000), dynamically growing collection. Such a collection may be expected to be heterogeneous, both statically heterogeneous (containing documents in a variety of formats) and dynamically heterogeneous (likely to acquire new documents in formats unlike any prior acquisitions). Eventually, we hope to be able to totally automate metadata extraction for 80% of the documents and reduce the time needed to generate the metadata for the remaining documents also by 80%. In this paper, we describe our process of first classifying documents into equivalence classes for which we can then use a rule-based approach to extract metadata. Our rule-based approach differs from others in as far as it separates the rule-interpreting engine from a template of rules. The templates vary among classes but the engine is the same. We have evaluated our approach on a test bed of 7413 randomly selected documents from the DTIC (Defense Technical Information Center) collection with encouraging results. Finally, we describe how we can use this process to generate an OAI (Open Archive Initiatives) - compliant digital library from a stream of incoming documents.
Year
Venue
Keywords
2006
ELPUB 1997
digital library,metadata extraction,oai,rule based,test bed
Field
DocType
Citations 
Metadata repository,Metadata,World Wide Web,Information retrieval,Computer science,Technical information,Equivalence class,Digital library
Conference
2
PageRank 
References 
Authors
0.48
8
7
Name
Order
Citations
PageRank
jianfeng tang120.48
Kurt Maly2567139.93
Steven J. Zeil312634.82
Mohammad Zubair458789.90
nicolas robinson520.48
tibor simko620.48
martin vesely720.48