Discussion
Loading...

Post

Log in
  • About
  • Code of conduct
  • Privacy
  • Users
  • Instances
  • About Bonfire
nicdex 馃嚚馃嚘  馃嚭馃嚘
nicdex 馃嚚馃嚘 馃嚭馃嚘
@nicdex@techhub.social  路  activity timestamp 2 days ago

Some a-hole is scraping my personal git(ea) server >:(
Probably some AI training B.S. and they are using a Residential proxy so hard to block.
Any suggestions?
#ai #scraperBot

  • Copy link
  • Flag this post
  • Block
Ivo Bl枚chliger
Ivo Bl枚chliger
@aigledesalpes@techhub.social replied  路  activity timestamp 2 days ago

@nicdex About a week ago, our #dokuwiki server was DDos'd by 10'000 costly diff requests per hour, from about 9950 unique IPs all over the world. Worse, some requests just timed out, saturating all apache connections. Used @splitbrain s botchecker and reduced Apaches timeout to 15 secs.
https://github.com/splitbrain/botcheck
Smooth sailing since then, and after two days, the request flood receded.

GitHub

GitHub - splitbrain/botcheck: Block bots in Apache using mod_rewrite only

Block bots in Apache using mod_rewrite only. Contribute to splitbrain/botcheck development by creating an account on GitHub.
  • Copy link
  • Flag this comment
  • Block

bonfire.cafe

A space for Bonfire maintainers and contributors to communicate

bonfire.cafe: About 路 Code of conduct 路 Privacy 路 Users 路 Instances
Bonfire social 路 1.0.2-alpha.7 no JS en
Automatic federation enabled
Log in
  • Explore
  • About
  • Members
  • Code of Conduct