> Author, title, and publication year.... won't get you many false positives,
> but might get you lots of false negatives.
>
> It's certainly true that there is no good "naive" approach to matching
> without identifiers and getting a good balance of minimal false positives
> and false negatives. There are tricky ways to approach it I haven't really
> tried yet, you can sometimes get closer to "good enough" than you think with
> just author/title or author/title/year.
>
> Depends on the source of your data too. If you have an AACR2/NAF controlled
> heading for an author, instead of just a free-text author entry field, that
> certainly makes it easier.


You're right -- I meant false negatives since the data often doesn't line
up. And I agree that with author, title, and year you can get pretty far.
But once you get into lesser used stuff, the names won't be controlled,
you'll see lots of minimal level records with missing data elements,
nonunique titles, and other problems. It gets messy fast.

kyle

Reply via email to
https://www.mail-archive.com/code4lib@listserv.nd.edu/msg08286.html
www.mail-archive.com
CC-MAIN-2023-06
9260
application/http; msgtype=response
sha1:IKXKP3R5JRZ6SKWMSMVROHYZFILE4XZI
<urn:uuid:ccd9ee41-f114-4ce5-9002-47acab10a987>
2023-01-31T10:26:30Z
72.52.77.8
text/html
sha1:ZXAT4CE2ZTW5DYCNDLQRQUMVZN62HRQK
<urn:uuid:a2e64907-5394-43cf-9763-5d0d65ae783a>
https://www.mail-archive.com/code4lib@listserv.nd.edu/msg08286.html
response
<urn:uuid:be2d1d8b-dfe6-4a28-a3a0-a3d79ffbfb9a>
isPartOf: CC-MAIN-2023-06
publisher: Common Crawl
description: Wide crawl of the web for January/February 2023
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-61
software: Apache Nutch 1.19 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.4-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/