Natural Language Processing for Discovery of Born-Digital Records

How do we move from discussing new technologies to actually implementing them? This presentation will cover several applications of NLP (natural language processing) for improving discovery of born-digital records in special collections and archives, focusing on two NLP-centered projects at the North Carolina State University Special Collections Research Center. The first is the implementation of out-of-the-box software tools to enable browsing collections by named entities in the reading room. The second project is the integration of named entity recognition and topic modeling into born-digital processing workflows in order to improve and automate aggregate description of collections. The presentation evaluates the success of these projects and describes possibilities for the future extension of these tools vis-à-vis practical applications. This presentation is framed in terms of working solutions that add value to the researcher experience in the library, and works to fill the gap between theoretical discussion of these tools and realized application.

Speaker(s)

01:30 PM
15 minutes
https://2019.code4lib.org/talks/Natural-Language-Processing-for-Discovery-of-BornDigital-Records
2019.code4lib.org
crawl=CC-MAIN-2019-09
10185
application/http; msgtype=response
sha1:WSK3ITNJ7IWHJF75JQ7ANU5L7ER6T2UI
<urn:uuid:520e209e-3375-42c1-9422-2808d80d3a34>
2019-02-16T00:07:10Z
185.199.109.153
text/html
sha1:MIXSTDNAKZBPAUVB3HYG4B3QYCLNINB4
<urn:uuid:0b21fab1-c3a2-4a39-8c41-1d4412fdeaa6>
https://2019.code4lib.org/talks/Natural-Language-Processing-for-Discovery-of-BornDigital-Records
response
<urn:uuid:8810d1bb-399c-4627-9aae-0d71d2f3f75e>
isPartOf: CC-MAIN-2019-09
publisher: Common Crawl
description: Wide crawl of the web for February 2019
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-154-78-3.ec2.internal
software: Apache Nutch 1.15 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 0.11-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/