User:bzc6p

From Archiveteam
Revision as of 18:51, 4 September 2017 by Bzc6p (talk | contribs) (Medium-sized websites: + pics.coldline.hu)
Jump to: navigation, search
This user has suspended almost all of his archiving activities due to his other duties, until further notice.

„Beauty consists of its own passing, just as we reach for it. It’s the ephemeral configuration of things in the moment, when you see both their beauty and their death. [...] Maybe that’s what being alive is all about: so we can track down those moments that are dying.”

„Az a szép, amit akkor ragad meg az ember, miközben elmúlik. A dolgok tiszavirág-életű formája abban a percben, amikor egyszerre látjuk életüket és a pusztulásukat. [...] Talán ilyen az, hogy élők vagyunk: olyan pillanatokat hajszolunk, amelyek elenyésznek.”

Muriel Barbery


bzc6p is a Hungarian amateur who joined the efforts of ArchiveTeam. "Specialized" in watching and saving Hungarian websites.

Kapcsolat: vichratimot (kukac) euromail (pont) hu

Contact: vichratimot (at) euromail (dot) hu


My projects

Websites that I've archived, I'm archiving or I've took part in organizing their archival, in reversed chronological order in each category. If the website has an entry on this wiki, consult that page for the archives. If not, a link to the archives should be found in the appropriate line.

Large websites

Medium-sized websites

Small websites

To-do list

Hungarian websites that should be saved in the near future. I don't reserve them as my projects, as I fear I won't have time for them soon.

  1. In progress nol.hu – after being darkened on 2016-10-08, returned on 2016-12-13 as an archive
  2. TVN.hu websites – site seems to be okay, but company behind it is very much in the red for years now
  3. Ingyenweb – a very old and obsoleted free webhosting site not cared for by the maintainer. Also sitting on some valuable domain names
  4. videok.hu – a video sharing site not (any more) too popular, not really cared for, owner same as the one of Ingyenweb
  5. News+C: Saving (Hungarian) news websites that have considerable amount of user content (=Comments).

Philosophy

My experience with my few website archiving endavours so far suggests that there are very few websites today that can be mirrored completely in automated ways without human control and intervention. Thus, if one wants to make quality archives even of a small website, it needs more or less attention, often additional work, or several, supplemental runs of archiving tools.

These archiving tools (wget, wpull, ArchiveBot etc.) are very important and useful, but in most cases, are themselves incapable of making complete archives. My philosophy is that we should do as complete and quality archives as possible, if we set off on the journey of archiving a website, so we cannot rely solely on these tools. Of course, constrained by time and resources, we must make a compromise. Otherwise, however, the above applies. At least for me. This is how I archive.

Recommended tools

Saving to WARC

  • Chfoo's Wpull: a good alternative to wget, still being developed, with good archiving support
  • wget: faster, but lacks some handy features wpull already has got, and is pretty much in its final state
  • Ikreymer's webrecorder.io: save while browsing, when things are too difficult

Replaying WARCs

  • Alard's warc-proxy: using a proxy, provides more accurate replay, but doesn't support HTTPS, and development seems to be stopped
  • Ikreymer's webarchiveplayer: doesn't use proxy, works similarly to the Wayback Machine, but because of that some URLs are not rewritten in the files and may not play back properly

Uploading to IA

  • Kngenie's ias3upload: just uploading, and needs a metadata CSV-file beforehand, but otherwise works fine
  • IA-developed internetarchive: more versatile tool (upload, download, search etc.)
  • Direct use of the Internet Archive S3 API with the curl program. The above uploading tools are based on this interface.

Further plans

I hope one day I can re-host Hungarian websites that are dead now but have been archived. Or, at least, create a Wayback Machine for Hungarian websites, that would also serve as a mirror to the corresponding Internet Archive items.

As for the URL Team project, given that the discovered URLs have not been saved in WARC format (yet) but in a format difficult to access and read, a shorturl-resolver service for already gone URL shorteners would be useful. It would be kind of a Wayback Machine for URL shorteners. It wouldn't even be difficult to set up, based on URL Team databases.

I would also be glad to record Hungarian radio and television channels' programme 24/7, but that would require a vast amount of resources, Until / instead of that, I'll probably collect some recordings of notable Hungarian TV and radio programmes and moments from YouTube.

Hungarian articles about Archive Team

Below I've collected online Hungarian news articles published about Archive Team that I've been able to find. The list is in reversed chronological order.
https://www.archiveteam.org/index.php?title=User:Bzc6p&oldid=29689
www.archiveteam.org
crawl=CC-MAIN-2019-51
33591
application/http; msgtype=response
sha1:7MAMZRVB36KBFUROGRV2PELUM3XWNFEE
<urn:uuid:dcbf3278-b9ae-4168-b7a7-4ad214603fe0>
2019-12-06T07:51:18Z
204.109.60.27
text/html
sha1:M5UYYKBAW4G4XVVNED7OYW5ZTOPSKUCL
<urn:uuid:2c1995d3-4476-4751-bc39-cc268a47747d>
https://www.archiveteam.org/index.php?title=User:Bzc6p&oldid=29689
response
<urn:uuid:ef8b905c-50ed-4dce-a3f6-3446fee43959>
isPartOf: CC-MAIN-2019-51
publisher: Common Crawl
description: Wide crawl of the web for December 2019
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-227.ec2.internal
software: Apache Nutch 1.16 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.1-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/