You are viewing a single comment's thread.

view the rest of the comments →

Water ago

Hasn't 8 Chan not shown up on search for months

Drenki ago

Looks like their site is semi-indexed. 8 chan has less restriction on what can be posted and sometimes illegal stuff gets on there so Google was trying to filter that out. http://archive.is/rC7Ya

The 8ch.net/robots.txt file looks like this:

User-agent: *
Disallow: /über/

robots.txt is the file that things like search engine crawlers are supposed to use as guidance for what they're allowed to index. No one makes them follow it, though.

Now, that's how it appears as ASCII, but as UTF8 encoding, it's über. No idea if this is some kind of joke or something but it's indexed in my search results!