I should, of course, profile it correctly, not just armchair it. Some other time, maybe.
Discussion
Loading...
Nevertheless, this got me thinking: how can I avoid the TLS tax, without firewalling them?
If my maze would lead to poisoned domains, would I be able to look at SNI, and simply drop it there and then?
Probably not, because that would prevent all bots from scraping the poisoned URLs, so they'd never end up in their queue.
Which means, I will have to do TLS, and HTTP to keep poisoning, and the firewalling can only be temporary.
That's ok, these waves aren't too common yet, so temporarily firewalling baddies off is acceptable.