You are viewing a javascript disabled version of the site. Please enable Javascript for this site to function properly.
Go to headerGo to navigationGo to searchGo to contentsGo to footer
In content section. Select this link to jump to navigation

Deduplication of metadata harvested from Open Archives Initiative repositories

Issue title: Mining the Digital Information Networks

Guest editors: Niklas LavessonGuest Editor, Peter LindeGuest Editor and Panayiota PolydoratouGuest Editor

Article type: Research Article

Authors: Wendykier, Piotr

Affiliations: Interdisciplinary Centre for Mathematical and Computational Modelling, University of Warsaw, ul. Prosta 69, 00-838 Warsaw, Poland. E-mail: [email protected]

Keywords: Deduplication, record linkage, metadata, Dublin core, open access, OAI–PMH

DOI: 10.3233/ISU-130695

Journal: Information Services & Use, vol. 33, no. 2, pp. 77-86, 2013

Published: 30 October 2013
Get PDF open access

Abstract

Open access (OA) is a way of providing unrestricted access via the Internet to peer-reviewed journal articles as well as theses, monographs and book chapters. Many open access repositories have been created in the last decade. There is also a number of registry websites that index these repositories. This article analyzes the repositories indexed by the Open Archives Initiative (OAI) organization in terms of record duplication. Based on the sample of 958 metadata files containing records modified in 2012 we provide an estimate on the number of duplicates in the entire collection of repositories indexed by OAI. In addition, this work describes several open source tools that form a generic workflow suitable for deduplication of bibliographic records.

Show more