archive.is is compromised. We need a new archiving strategy (Git repository) (pizzagate)

submitted ago by newworldahead

This is infuriating: https://voat.co/v/pizzagate/1569388

We need a new strategy to ensure that the evidence we share never disappear. I suggest we create a GiT repository for pizzagate.

What is GiT? GiT is a decentralized open source version control system. You can add as many files as you want in your GiT "repository". Any change to the files in the repository is kept. Nothing is ever destroyed unless you go out of your way to destroy it. Even if something gets removed from the repository, the history of the original file is kept.

Why would it help us? Thanks to its decentralized nature, all users can have their own up to date copy of the "main" repository. This means that if the main repository is taken down, the data is not lost.

How could we use it?

  1. archive.is allow us to download a zip archive of any page we save (see this comment https://voat.co/v/pizzagate/1569388/7648430))
  2. You should continue saving to archive.is.
  3. Then you download the zip file
  4. Then you put the zip file in your local pizzagate repository
  5. And you "push" (this is a GiT term) your changes to the main remote repository.
  6. A group of tech saavy people should be in charge of the main repository. (to moderate it and to keep the content well organized)

Of course we would need a nicely wrtiten tutorial to help non techy users to understand how to use GiT properly.

Your thoughts?

You are viewing a single comment's thread.

view the rest of the comments →

gittttttttttttttttt ago

I tried telling the community archive.is was comprimised and one of the shill mods deleted it! I don't think the mod is still here. I already have a git repo going every day on a cron job of all voat posts: https://gitlab.com/pizzascraper/pizzagate-scraper

git clone https://gitlab.com/pizzascraper/pizzagate-scraper.git

Archive.is brought in cloudflare to block all external URL's from being archived which my bot was doing. I don't have the space or funds to backup all external URL's just voat URL's. All external URL's are going into a txt file though currently but that isn't good enough. Some person said they were going to send $100 bitcoin and never did. If someone wants to help me financially I will rent a VPS with more space to backup all external URL's as well. Just DM me.

Non tech users can download a full zip without cloning

https://gitlab.com/pizzascraper/pizzagate-scraper/repository/archive.zip?ref=master

If you have questions or suggestions let me know. A lot of what was mentioned in this post is already being done.

newworldahead ago

This is awesome! I think I stumbled into your repository in the past but I didn't know it was still active. The only very important things missing are the external URLs, it needs to be done, but I understand the cost issue. GitLab has a limit of 10 gig, not so bad. If we forget about archiving youtube videos, I wonder how long would it take to reach this amount.

gittttttttttttttttt ago

Thanks. It was on the sidebar but sidebar has been cleaned up. It is still in the resources link https://voat.co/v/pizzagate/1517819 .

Yes gitlab has a 10gb limit. We are currently at 376M in archives/ folder. I am not sure if they count the .git objects which brings us to 677mb. I am zipping the post which is reducing file size by 90%. If we do external links we will increase size by a lot since there is a lot more external links in comments etc then there is voat posts. I can set up a git server as well. I just need the funds. I have the expertise. We may even need to use something other than git. Git starts lagging hard once it hits gigabytes. I encourage everyone to backup locally everything you see that is important.

Also do not forget this repo. Thousands of important files are in it.

https://gitlab.com/lurduyor/pizzagate

git clone https://gitlab.com/lurduyor/pizzagate

download link for non tech users or people who want faster downloads:

https://gitlab.com/lurduyor/pizzagate/repository/archive.zip?ref=master

gittttttttttttttttt ago

Also if you know any other archive sites ( preferably smaller ) let me know. archive.is, archive.fo, archive.org, google cache won't work to make POST requests. It was working for a bit but I think they cracked down because of pizzagate. I could send post requests to back them up. But we still are at risk of deletion trusting third parties.

We may need to take things down to the deep web. If anyone knows any archive sites on the deep web let me know.