You are viewing a single comment's thread.

view the rest of the comments →

Le_Squish ago

Maybe hooktube no want to be indexed?

awshidahak ago

From https://hooktube.com/robots.txt

User-agent: *
Crawl-delay: 500
Disallow:/api
Disallow:/category
Disallow:/user
Disallow:/channel
Disallow:/results
Disallow:/random

Youtube, however, seems to have no robots.txt,

DrSelfAppointed ago

I honestly had not considered that...