Elpub : Digital Library : Works

Paper 107_elpub2006:
Automated Building of OAI Compliant Repository from Legacy Collection

id 107_elpub2006
authors Tang, Jianfeng; Maly, Kurt; Zeil, Steven; Zubair, Mohammad
year 2006
title Automated Building of OAI Compliant Repository from Legacy Collection
source ELPUB2006. Digital Spectrum: Integrating Technology and Culture - Proceedings of the 10th International Conference on Electronic Publishing held in Bansko, Bulgaria 14-16 June 2006 / Edited by: Bob Martens, Milena Dobreva. ISBN 978-954-16-0040-5, 2006, pp. 101-112
summary In this paper, we report on our experience with the creation of an automated, human-assisted process to extract metadata from documents in a large (>100,000), dynamically growing collection. Such a collection may be expected to be heterogeneous, both statically heterogeneous (containing documents in a variety of formats) and dynamically heterogeneous (likely to acquire new documents in formats unlike any prior acquisitions). Eventually, we hope to be able to totally automate metadata extraction for 80% of the documents and reduce the time needed to generate the metadata for the remaining documents also by 80%. In this paper, we describe our process of first classifying documents into equivalence classes for which we can then use a rule-based approach to extract metadata. Our rule-based approach differs from others in as far as it separates the rule-interpreting engine from a template of rules. The templates vary among classes but the engine is the same. We have evaluated our approach on a test bed of 7413 randomly selected documents from the DTIC (Defense Technical Information Center) collection with encouraging results. Finally, we describe how we can use this process to generate an OAI (Open Archive Initiatives) - compliant digital library from a stream of incoming documents.
keywords metadata extraction; digital library; OAI
series ELPUB:2006
type normal paper
email maly@cs.odu.edu
more http://info.tuwien.ac.at/elpub2006/presentations/107.ppt
content file.pdf (800,918 bytes)
discussion No discussions. Post discussion ...
ratings
urn:nbn urn:nbn:se:elpub-107_elpub2006
last changed 2006/06/24 11:13
HOMELOGIN (you are user _anon_706218 from group guest) Powered by SciX Open Publishing Services 1.002