Warnings, Caveats and Weasel Words

Most of the experiments linked to here are running on R&D equipment in a non-production environment. They may disappear without warning and/or perform erratically. If one of them isn’t working for some reason, come back later and try again.

Reverse Domain Lookup

 2 minute read.
Note: This experiment has graduated. This description has been kept for reference, but many of the links and/or services that appear below no longer work.

This service has graduated and metamorphised into Event Data Reverse. I know, we suck at naming things.

Take a domain name and find out whether it belongs to a Crossref member. Why on earth would you want to do such a thing? Well, you might be interested in analysing your log files and determining whether links to your site are coming from scholarly publishers. Or you might be building some snazzy new “alt-metrics” tools and want to be able to detect when people link to a scholarly publisher. In either case, this now allows you to take a domain name (e.g. plosbiology.org) and quickly determine whether it belongs to a Crossref member (i.e. a scholarly publisher) as well as the name of said publisher.

We’ve developed an example service, which you can call dynamically, a browser button, which allows you to play with the service interactively, and we’ve also created a downloadable list of the domain names (hashed) which you can use locally if speed is of the essence.

The service page linked to above contains documentation and plenty of weasel words explaining the limitations of the system.

If you have any comments, suggestions or bug reports please fee free to send them to us here at:

labs_email

Last modified: 2020-10-07.
https://www.crossref.org/labs/reverse-domain-lookup/
www.crossref.org
crawl=CC-MAIN-2020-50
45213
application/http; msgtype=response
sha1:JJ37YBMEZ3FZ2M42M73NNLTNUNF26DQE
<urn:uuid:ed576ecc-d343-48fd-81cc-34e20a279eb2>
2020-12-02T13:31:58Z
208.254.38.78
text/html
sha1:Z3BWPVK5LQ3H2IZZPMY75VKQYKUZ2OEI
<urn:uuid:1c167e1e-24bd-4b7f-84ba-be75d6116a80>
https://www.crossref.org/labs/reverse-domain-lookup/
response
<urn:uuid:82191fdc-bbbf-4231-9fe0-14488ac6162a>
isPartOf: CC-MAIN-2020-50
publisher: Common Crawl
description: Wide crawl of the web for November/December 2020
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-88.ec2.internal
software: Apache Nutch 1.17 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.2-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/