GeoCities Japan

From Archiveteam
Revision as of 00:35, 5 November 2018 by Hiroi (talk | contribs) (Updating discovery info)
Jump to: navigation, search
GeoCities Japan
GeoCities Japan logo
Employee captured tearing page.png
URL http://www.geocities.jp/, http://www.geocities.co.jp/
Project status Closing
Archiving status In progress...
Project source Unknown
Project tracker Unknown
IRC channel #notagain (on EFnet)
Project lead Unknown

GeoCities Japan is the Japanese version of GeoCities. It survived the 2009 shutdown of the global platform.

Shutdown

On 2018-10-01, Yahoo! Japan announced that they would be closing GeoCities at the end of March 2019. (New accounts can still be created until 2019-01-10.)

Discovery Info

  • Several records available at: https://anonfile.com/z1z62ak8ba/records_zip
    • geocities_jp_first.txt: First level subdirectory list under geocities.jp, compiled from IA CDX data. 566,690 records in total.
    • geocities_co_jp_first.txt: Same as above, for geocities.co.jp. 12,470 records in total.
      • NOTE: The majority of sites under geocities.co.jp are not first-level sites, but "field" sites which are second-level (there could be, in theory, 1.79M of them; how many actually exist unknown), see explanation below.
    • blogs_yahoo_co_jp_first.txt: Same as above, for blogs.yahoo.co.jp. 646,901 records in total.
    • geocities_co_jp_fields.txt: List of field names under geocities.co.jp.
      • Individual websites are listed in the following format: "http://www.geocities.co.jp/[FieldName]/[AAAA]" where AAAA ranges from 0000 to 9999.
    • include-surts.txt: List of subdomains that should be allowed by your crawler.
https://www.archiveteam.org/index.php?title=GeoCities_Japan&oldid=31768
www.archiveteam.org
crawl=CC-MAIN-2020-24
19598
application/http; msgtype=response
sha1:D5OJSMI7ON5S7XPDG5HVR6TLOCIKORUI
<urn:uuid:ec30b87b-398f-4b94-9150-183131adcc90>
2020-06-06T03:24:47Z
204.109.60.27
text/html
sha1:ZIVCXMXCTKDEKGZDYF672PWHJRZAQGPD
<urn:uuid:4834e20e-a53b-4725-97d8-d5e6e3df59da>
https://www.archiveteam.org/index.php?title=GeoCities_Japan&oldid=31768
response
<urn:uuid:23477495-274e-4485-bf87-f7a8aa0877b2>
isPartOf: CC-MAIN-2020-24
publisher: Common Crawl
description: Wide crawl of the web for May/June 2020
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-236.ec2.internal
software: Apache Nutch 1.16 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.1-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/