Changes Coming to the BHL Data Exports Files on 10 April 2019

On 10 April 2019, we will implement additions and changes to the export files available from the Biodiversity Heritage Library.

The updates involve the following:

  1. A new set of exports will be created alongside the existing exports. The new set will contain only data for material that is hosted by BHL. No externally-hosted content will be included in these files. Because these files are added in addition to the existing export files, no existing users should be affected.
  2. The BHL author Identifiers will be added to the creator.txt and partcreator.txt tab-delimited files. The format of these files will change to accommodate the additional data; the author identifier will now be the second “column” in each file. Because of this, anyone regularly harvesting from these files may be affected.

Additional detailed information about these updates will be reflected on the Data Exports: Developer and Data Tools webpage, effective 10 April 2019.

If you have questions, please feel free to submit feedback via this form.

Avatar for Grace Costantino
Written by

Grace Costantino served as the Outreach and Communication Manager for the Biodiversity Heritage Library from 2014 to 2021. In this capacity, she developed and managed BHL's communication strategy, oversaw social media initiatives, and engaged with the public to excite audiences about the wealth of biodiversity heritage available in BHL. Prior to her role as Outreach and Communication Manager, Grace served as the Digital Collections Librarian for Smithsonian Libraries and as the Program Manager for BHL.
https://blog.biodiversitylibrary.org/2019/04/changes-coming-bhl-data-exports.html
blog.biodiversitylibrary.org
crawl=CC-MAIN-2021-43
71358
application/http; msgtype=response
sha1:ZNJXRET4FMEBT4ETAWIDVPQPZW3IC6WF
<urn:uuid:7c8219f4-9ea3-40e5-809c-d278f2346473>
2021-10-17T07:25:18Z
160.111.244.49
text/html
sha1:RCGE4PVRHTYNTNGLABVPG2KFFC6ECOZV
<urn:uuid:19895818-0602-4f7f-b5bc-382d248047f5>
https://blog.biodiversitylibrary.org/2019/04/changes-coming-bhl-data-exports.html
response
<urn:uuid:2cf43dce-63e3-40ae-b6c1-747dfd413525>
isPartOf: CC-MAIN-2021-43
publisher: Common Crawl
description: Wide crawl of the web for October 2021
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-191
software: Apache Nutch 1.18 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.2-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/