Hi Daniel,

 

I’d suggest trying out Google Refine (now Open Refine): https://code.google.com/p/google-refine/.  The following slideshare offers some details about my own process, some of which I have since, well, refined:  http://www.slideshare.net/steganogram/approaching-authority-a-preliminary-implementation-of-encoded-archival-context-eaccpf-at-east-carolina-university

 

Additionally, now that OCLC is adding VIAF numbers to Wikipedia entries, some of those VIAF IDs might be even easier to get at since everything in DBpedia should presumably wind up in the Freebase database, too (the only importance there is that the Freebase database was very tightly integrated into G. Refine, so it made those queries and responses even easier to implement pretty quickly).

 

Mark

 

 

 

From: Encoded Archival Description List [mailto:[log in to unmask]] On Behalf Of Daniel Johnson
Sent: Thursday, March 28, 2013 12:31 PM
To: [log in to unmask]
Subject: Batch Searching Authority Files

 

EADers,

 

I am working with a collection of extremist material and from an inventory of the collection I have a list of about 30,000 organization names. I am trying to figure out some sort of way to batch search the organization names I have against an authority file like LoC or VIAF. I am wondering if anyone out there has done anything like this or knows if there is a tool that I could use to help me. I am going to be creating EAC-CPF records for these organizations, but knowing which of them have an authority record would be a great start. 

 

Thanks!

 

Daniel Johnson
Project Archivist (Hall/Hoag)
Special Collections
John Hay Library, Box A
Brown University

http://blogs.brown.edu/hallhoag/
https://listserv.loc.gov/cgi-bin/wa?A3=ind1303&L=EAD&E=quoted-printable&P=198286&B=--_000_DCB910FAD4CF9343B3E424AF5F33102501650E6Dx10mbx8yuyaleed_&T=text%2Fhtml;%20charset=us-ascii&pending=
listserv.loc.gov
crawl=CC-MAIN-2022-33
6605
application/http; msgtype=response
sha1:ZF5YADD4GF66XQFR5ET5MNKD3EFHYK2N
<urn:uuid:451585d7-3652-4417-b636-cb1fbfcc6d82>
2022-08-10T09:23:53Z
140.147.239.86
text/html
sha1:OMPCEQWPEY3RFEVSDICRZOCPRB6XUGDY
<urn:uuid:94c5a4dd-78e2-481b-9b32-c83f74441aab>
https://listserv.loc.gov/cgi-bin/wa?A3=ind1303&L=EAD&E=quoted-printable&P=198286&B=--_000_DCB910FAD4CF9343B3E424AF5F33102501650E6Dx10mbx8yuyaleed_&T=text%2Fhtml;%20charset=us-ascii&pending=
response
<urn:uuid:d772e07a-f562-48f0-a951-1ca53b56d11c>
isPartOf: CC-MAIN-2022-33
publisher: Common Crawl
description: Wide crawl of the web for August 2022
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-170
software: Apache Nutch 1.18 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.4-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/