Storify

From Archiveteam
Jump to: navigation, search
Storify
Storify logo
Storify closing notice large.png
URL https://storify.com/
Project status Offline
Archiving status Partially saved
Project source Unknown
Project tracker Unknown
IRC channel #horrify
Project lead User:JustAnotherArchivist

Storify was a site that allowed you to weave together multiple tweets into a full article.

On December 12, 2017, it put a notice on its homepage that it's shutting down on May 16, 2018. Specifically, new accounts could no longer be created, and by 5 pm PST on May 16, all content would disappear:

Storify Update

Thank you to everyone who has contributed stories to our Storify community. Unfortunately, we are no longer allowing new users to sign up and will end existing users' access to Storify.com on May 16, 2018. We are committed to making the transition as smooth as possible. Please read the FAQ for more information.

More details were posted in their FAQ, instructing people how to extract their stories and mentioning the 5 pm PST deadline for API access. The FAQ also said that new stories could no longer be created from 2018-05-10, but this was not enforced, and new stories were still being created on the shutdown date.

Archival

A list of users was retrieved from Storify's API. Unfortunately, this list is incomplete: the API endpoint appears to have been implemented very inefficiently, leading to a massive slowdown with progressing result page number and eventually reaching an internal timeout on the Storify server side of 15 seconds. A total of 5302069 users were discovered in this way.

These users and all of their subscribers/followers and subscriptions/followings were archived successfully with all their stories for a total of 5323625 users, approximately 103 million URLs, and about 650 GiB of gzipped WARCs. The data is currently (June 2018) being post-processed to filter out error pages that would make browsing the archives quite unpleasant as Storify's servers replied with 503 to about 13 % (16 million) of the requests.
https://www.archiveteam.org/index.php?title=Storify
www.archiveteam.org
crawl=CC-MAIN-2018-39
17735
application/http; msgtype=response
sha1:IO4FEAC5P2DN7U5RAKNX4FOLGITMAZOP
<urn:uuid:cf68bf0c-46ae-40db-948e-f9d7f5f52751>
2018-09-22T07:23:40Z
204.109.60.27
text/html
sha1:DITF6D3YBF7HCCXUQPEABOXUBR36KY42
<urn:uuid:e6975c9a-c593-4247-8aab-1fc72cf2eac7>
https://www.archiveteam.org/index.php?title=Storify
response
<urn:uuid:e987e3cf-aecd-42b6-bb8a-e96291b03c42>
isPartOf: CC-MAIN-2018-39
publisher: Common Crawl
description: Wide crawl of the web for September 2018
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-95-180-234.ec2.internal
software: Apache Nutch 1.15 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 0.11-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/