Collecting and preserving portions of the WWW
7
votes
1answer
100 views
Web archives that collect/request analytics of harvested sites?
Are there any web archiving projects or web archives that also collect/request web analytics of the harvested sites as part of the collection?
8
votes
2answers
193 views
Converting BagIt files to WARC
In Italy, for an ongoing experiment of digital legal deposit, national libraries are receiving bagit files from publishers (usually harvested from their own FTP or HTTP sites).
The idea is to ...
4
votes
4answers
202 views
Characterization of WARC files contents?
I am looking a tool that given a WARC file produces and presents a characterization of the contents included in this archive.
The goal is to have a quick broad characterization of a collection of web ...
13
votes
3answers
253 views
What data format and tools exist for archiving tweets and similar microblogging?
I wonder whether there is a data format for archiving messages from twitter and similar microblogging sites, including metadata. The Library of Congress gets all messages from Twitter but I found no ...
10
votes
2answers
395 views
What is the best format/standard for archiving static web pages? What software generates that format?
Assuming a static website (or a dynamic website that I'm choosing to archive as a static site), what is the best file format or standard to use to capture all of the dependencies (embedded images, ...
6
votes
4answers
90 views
What attempts, if any, have been made to catalogue and archive threads on Internet forums?
There is a significant amount of useful information available on Internet forums, and it can be really frustrating when these forums get deleted and a huge amount of extremely useful information gets ...
10
votes
2answers
182 views
Has archive.org removed or deleted sites from its database?
I've seen many archive.org pages that I could no longer access because after the site got deleted, a domain took over the site and put robots.txt restriction protocol over the site...
15
votes
4answers
166 views
Are there any libraries that are trying to preserve information in Ajax-heavy websites that archive.org can't preserve?
Archive.org used to be far more useful, but now there is a huge problem - it can't archive a huge number of the Ajax-heavy websites on the Internet now.
