In Italy, for an ongoing experiment of digital legal deposit, national libraries are receiving
bagit files from publishers (usually harvested from their own FTP or HTTP sites).
The idea is to convert these bags into WARC and store in a common repository of web archives (accessed with the Wayback Machine).
How do you suggest this would be best managed?
The ideal solution should be the RESTful bag server exposing the bag content and crawling it with Heritrix 3.
In the meantime of not having an implementation of the bag server, we could unpack the bag in a static web server (with a stable URL), give it some namespace, and later crawl it.
According to the warc specs a resource can be any URI. Is it safe to give it a URL or is better to use something like an urn?
Furthermore, do you know if Wayback deals with resources that are not URLs?