I have a text-only archive of the Internet since 1992. 52TB raw including edits. 22TB without. Crawlers have indexed 82 search engines since AltaVista.

I have a text-only archive of the Internet since 1992. 52TB raw including edits. 22TB without. Crawlers have indexed 82 search engines since AltaVista. (whatever)

submitted 5.7 years ago by virge

191 comments

You are viewing a single comment's thread.

view the rest of the comments →

shmuklidooha 5.7 years ago

52 TB? That seems a bit small. I'd think that it would be more along the lines of PB or even EB.

link

peacegnome 5.7 years ago

Text only could be low, especially if English (or latin alphabet only) only and compressed.

link

TheBudhha 5.7 years ago

Yeah. But explain 20plus TB of "edits".

link

NarrativeControl 5.7 years ago

But explain 20plus TB of "edits"

He probably crawled the same texts at different points in time, several times. Those are the "edits": the differences between those texts. At least that's my guess.

link

TheBudhha 5.7 years ago

I have a funny feeling his files will magically become corrupt or go missing before he is able to post them.

link

sirRantsalot 5.7 years ago

You sound pretty certain.....

link

NotHereForPizza 5.7 years ago

Well, I think Crensch has been right once or twice. Maybe it'll be a third time. Who knows?

link

sirRantsalot 5.7 years ago

All the creepiest crawlies are out today.

link

NotHereForPizza 5.7 years ago

huh?...

link

sirRantsalot 5.7 years ago

I was told you were a pedo.

link

NotHereForPizza 5.7 years ago

And? You just believe people for no reason?

link

sirRantsalot 5.7 years ago

They gave false testimony, laid out a convincing argument. I'm kind of dumb, too. But nobody believes it because I have a large vocabuditty.

link

ShakklezthaKlown 5.7 years ago

why do you sound like a cop playing dumb?

link

sirRantsalot 5.7 years ago

I'm a nobody. Just a hyperborean wanderer, marvelling at what I see.

link

ShakklezthaKlown 5.7 years ago

something in the air.

link