Discussion
Loading...

Post

  • About
  • Code of conduct
  • Privacy
  • Users
  • Instances
  • About Bonfire
julian
@julian@activitypub.space  ·  activity timestamp 2 weeks ago

Are other instance admins running into AI crawlers impacting availability?

A general call-out to #fediadmin about whether they have been experiencing issues with site availability, specifically an on-again off-again bot wave that crawls publicly-available ActivityPub data at a rate so punishing that it overwhelms my server.

We had to turn on "I'm Under Attack" from the CF dashboard, but that comes with some not-so-nice tradeoffs (including blocking all automated crawlers, even the good ones.)

A general call-out to #fediadmin about whether they have been experiencing issues with site availability, specifically an on-again off-again bot wave that crawls publicly-available ActivityPub data at a rate so punishing that it overwhelms my server.

We had to turn on "I'm Under Attack" from the CF dashboard, but that comes with some not-so-nice tradeoffs (including blocking all automated crawlers, even the good ones.)

I initially thought someone just didn't like us (community.nodebb.org, actually), but now we've received reports of it happening to another NodeBB, and @silverpill@mitra.social's mitra.social is down for the count currently.

Admittedly, that last one could be unrelated.

  • Copy link
  • Flag this post
  • Block
Log in

bonfire.cafe

A space for Bonfire maintainers and contributors to communicate

bonfire.cafe: About · Code of conduct · Privacy · Users · Instances
Bonfire social · 1.0.0-rc.2.21 no JS en
Automatic federation enabled
  • Explore
  • About
  • Members
  • Code of Conduct
Home
Login