Difference between revisions of "User:Scumola"

From Archiveteam
Jump to navigation Jump to search
Line 5: Line 5:
== Steve has contributed to ==
== Steve has contributed to ==
* seed url list for geocities (using heritrix (archive.org) crawler)
* seed url list for geocities (using heritrix (archive.org) crawler)
* came up with the idea for the url-shortener archiving, but others have taken the lead on that project
* downloader for:
* downloader for:
** geocities
** geocities

Revision as of 21:19, 13 July 2011

Steve-o

on irc as swebb or swebb2 or swebb3, ...

Steve has contributed to

  • seed url list for geocities (using heritrix (archive.org) crawler)
  • came up with the idea for the url-shortener archiving, but others have taken the lead on that project
  • downloader for:
    • geocities
    • yahoo video
    • google video
    • google groups

Steve maintains

NNTP Newsgroups

IRC Log Bot

Contact

Steve Webb - http://badcheese.com - bigwebb [@] gmail (DoT) com
https://wiki.archiveteam.org/index.php?title=User:Scumola&diff=6154&oldid=6153
wiki.archiveteam.org
crawl=CC-MAIN-2022-27
22022
application/http; msgtype=response
sha1:6I2FAB7WDUBBCYIZS3IO3EKXKDAJTMT4
<urn:uuid:e8c9ae21-485c-4c6f-a12b-2691af0f3676>
2022-07-02T04:47:23Z
213.184.85.58
text/html
sha1:XQG53WCT2QH5CKO7PLYVVXJE56FX2INQ
<urn:uuid:362bcb98-a797-4993-bd7c-1c05169b28e3>
https://wiki.archiveteam.org/index.php?title=User:Scumola&diff=6154&oldid=6153
response
<urn:uuid:6d3ae9e6-7529-4f4e-82bd-87081caf99e3>
isPartOf: CC-MAIN-2022-27
publisher: Common Crawl
description: Wide crawl of the web for June/July 2022
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-171
software: Apache Nutch 1.18 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.3-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/