Automated duplicate elimination in bibliographic systems

Issue title: THE DATABASE BUSINESS: Managing Today – Planning for Tomorrow. Papers from the 30th NFAIS Annual Conference

Guest editors: A.W. Elias

Article type: Research Article

Authors: Altom, Donald W.^a | Gilbert, Peggy^b | Meacham, Robert^b

Affiliations: [a] U.S. Department of Energy, Office of Scientific and Technical Information, Oak Ridge, TN, USA | [b] Science Applications International Corporation, Oak Ridge, TN, USA

Abstract: A computerized system for identifying and eliminating duplicate bibliographic citations collected from multiple data sources is presented. The system has been used successfully in building and maintaining databases at the Department of Energy's Office of Scientific and Technical Information since 1984. Compressed keys for author and title fields are used to locate potential duplicates, which are further checked by comparing compressed keys for report number, patent number, CODEN, date, page, volume-issue, and publisher. To aid in comparison, each field is weighted according to its value in identifying and discriminating among duplicates.

DOI: 10.3233/ISU-1988-82-416

Journal: Information Services & Use, vol. 8, no. 2-4, pp. 147-157, 1988