I had to make a filter list that included /v/pizzagate/new because as soon as my code tries to search for a link from a fresh post, even just a few minutes old, it will already be indexed by google and I have to filter it out of the results to avoid adding a link back to new.
It's fairly normal for high-traffic sites like this to have content ranked on Google fairly quickly. Even the Wiki (much, much smaller) will have new pages appear in Google searches the next day. It helps if Google is given things like sitemaps, robots.txt, etc.
Makes sense, thanks, that's a lot different than ranking an (oftentimes) stale website.
That's why google says to blog on your website even if no one reads it.
I was definitely the same when I started the Wiki. Fortunately making stuff like the sitemap is pretty painless yet effective. Here's a tool that'll quickly generate an XML sitemap so all you have to do is upload it to your site: https://www.xml-sitemaps.com
Yeah I don't see it incognito or not. But that's the way it's always been for me. I rarely see a specific voat post in the search results and when I do it's almost always just 1 reference which makes me think they're doing some sort of "throttling".
Now I'm searching same text again, this time NOT in incognito, and not finding it. However I did find this very post of mine.
/v/pizzagate - Voat
https://voat.co/v/pizzagate/new
3 days ago - I googled John Podesta 4/29/2017 and got this thread from Voat. Google ranked it quickly. (pizzagate). submitted 16 minutes ago by bopper to ...
Only with google though, not with Bing or Duck Duck Go. Is it because they are aware of my particular search history? They shouldn't, I use incognito and Duck Duck Go. How did the Voat thread get ranked so quickly?
ArthurEdens ago
Google has your view history in mind when you search. Someone that's never been on voat won't get the same result
bopper ago
Yeah, drives me crazy.
PizzagateBot ago
I had to make a filter list that included /v/pizzagate/new because as soon as my code tries to search for a link from a fresh post, even just a few minutes old, it will already be indexed by google and I have to filter it out of the results to avoid adding a link back to new.
Google crawls /v/pizzagate fast as fuck.
bopper ago
Wow.
PizzagateBot ago
OM NOM NOM NOM
PizzagateBot ago
cows go moo
PizzagateBot ago
hush you cow
RebelSkum ago
It's fairly normal for high-traffic sites like this to have content ranked on Google fairly quickly. Even the Wiki (much, much smaller) will have new pages appear in Google searches the next day. It helps if Google is given things like sitemaps, robots.txt, etc.
bopper ago
Makes sense, thanks, that's a lot different than ranking an (oftentimes) stale website. That's why google says to blog on your website even if no one reads it.
RebelSkum ago
Mystery solved, Scoob!
bopper ago
Yes. But I refuse to twitter on my website lol.
RebelSkum ago
I was definitely the same when I started the Wiki. Fortunately making stuff like the sitemap is pretty painless yet effective. Here's a tool that'll quickly generate an XML sitemap so all you have to do is upload it to your site: https://www.xml-sitemaps.com
bopper ago
I'm gonna go to Wordpress for my site. Thanks for this. (If you reply I'll read it tomorrow.)
DarkMath ago
What's the exact text you searched for in google? I just tried searching for "John Podesta" in google but got nothing.
DarkMath ago
Yeah I don't see it incognito or not. But that's the way it's always been for me. I rarely see a specific voat post in the search results and when I do it's almost always just 1 reference which makes me think they're doing some sort of "throttling".
Which reminds me of a Mister Metokur video describing it
bopper ago
John Podesta 4/29/2017 ... was what I searched.
Madwack ago
what I see
http://i.imgur.com/nq16a79.png
bopper ago
Now I'm searching same text again, this time NOT in incognito, and not finding it. However I did find this very post of mine.
bopper ago
Only with google though, not with Bing or Duck Duck Go. Is it because they are aware of my particular search history? They shouldn't, I use incognito and Duck Duck Go. How did the Voat thread get ranked so quickly?
I am a tech GURU. Not.
PizzagateBot ago
Hi! I created the following archive link(s) for this voat submission:
WARC files are created with https://webrecorder.io/
WARCs can be viewed offline with WARC replay tools like https://github.com/webrecorder/webrecorderplayer-electron
Final WARC will be created after 1 week from posting.
bopper ago
PizzaBot is a stalker!
HollandDrive ago
Why do they take a month to crawl a website but rank this the day after it's posted?
bopper ago
Dunno. I know only some basic SEO. It can be quite frustrating when it comes to one's own personal (business) website.