It is nice to see Cloudflare do what iocaine's been doing for a year now: tell multi-purpose crawlers to fuck right off.
Now if they'd get rid of the silly gating page even legit visitors have to pass, they might reach feature parity!
Discussion
It is nice to see Cloudflare do what iocaine's been doing for a year now: tell multi-purpose crawlers to fuck right off.
Now if they'd get rid of the silly gating page even legit visitors have to pass, they might reach feature parity!
I'm also happy to see that more and more entities are coming to the conclusion that opting out of Google Search is more beneficial for them than remaining indexed.
I've opted out of google search (and most commercial search along with it) way before iocaine even, and have not regretted it, not even one bit.
@algernon@come-from.mad-scientist.club you are also a Content Creator in a certain sense (arent we all) and a (micro-)Celebrity
@algernon
huh, I thought they've ha a crawler protection for a year now
@wolf480pl they did not block multi-purpose (eg, googlebot) crawlers before.