Improving access to digital collections by semantic enrichment


Presenters: Theo van Veen, Juliette Lonij

The collection of digitized historical newspapers of the National Library of the Netherlands contains an abundance of information about events, persons, concepts etc. As a first step towards automatically extracting some of this information from the unstructured text and using it to improve the findability and usability of our content we have developed a method to recognize named entities and link them to knowledge bases such as DBpedia and Wikidata.

Indexing relevant properties and identifiers from these knowledge bases along with the newspaper articles opens up new possibilities for searching articles, grouping search results by semantic relations and further exploration based on context – some of which we have implemented in a demonstration web portal. Moreover, we are setting up a crowdsourcing application for manual correction of any remaining errors and obtaining additional training data.

We are continuously working on further increasing the accuracy of the links by exploring new machine learning algorithms and adding new features. Our current focus is on incorporating word and entity embeddings, as we expect these representations to be a valuable addition to our existing, mostly hand-crafted features that may be useful for “more like this” search functionality and other information extraction tasks as well.


View the presentation
http://elag2017.org/?option=com_sppagebuilder&view=page&id=43
elag2017.org
crawl=CC-MAIN-2017-43
13663
application/http; msgtype=response
sha1:QXGYUTFEHQIAMJWX24DOQY3NMFTTANBT
<urn:uuid:c8a091a3-b039-46ce-9b6a-7bdbca7e15bd>
2017-10-23T13:09:23Z
5.9.177.115
application/xhtml+xml
sha1:FMFRBARWPNVQFW47DO73OJNRTTRJWVXO
<urn:uuid:afba0d3b-7c6b-4c8d-9686-c656967974c1>
http://elag2017.org/?option=com_sppagebuilder&view=page&id=43
length
response
<urn:uuid:7a40206e-7c5c-4712-a4d5-1c91e11930af>
robots: classic
hostname: ip-10-170-22-195.ec2.internal
software: Nutch 1.6 (CC)
isPartOf: CC-MAIN-2017-43
operator: Common Crawl Admin
description: Wide crawl of the web for October 2017
publisher: Common Crawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf