Wake up to a scraper doing 400k req/hour to packages.ecosyste.ms api, Windows Chrome with Simplified Chinese as the primary locale.
🔨 👮
4
Replies
0
Boosts
Looks like they did 780k req/hour on monday too. Rotating addresses to avoid per-ip rate limits, so it's not a dumb scraper or a residential proxy.
Looking into blocking browsers from loading data from the api unless it looks like it's being loaded as part of an fetch/xhr request.
The only downside to that is that you won't be able to paste an api url into your browser to play around with it.
I don't really want to play whack-a-mole with ip address ranges or user agents though.
On the residential proxy front, looks like they are now solving Anubis difficulty-5 at a pretty large scale 🙈
Seven old browser UAs shows 2.7M reqs from ~1.3M IPs over 5 days, ~580k solves/day total.
