Discussion
Loading...

Post

Log in
  • About
  • Code of conduct
  • Privacy
  • Users
  • Instances
  • About Bonfire
Stefano Marinelli
Stefano Marinelli
@stefano@mastodon.bsd.cafe  ·  activity timestamp 4 hours ago

Tonight the waves of bot traffic hitting many of the servers I manage have intensified, including Brew on BSD Cafe, but not only that. Honestly, the feeling I have now is no longer the same as it was some time ago (AI scrapers), but that there are real disruption operations going on. I can see it’s much more concentrated around certain providers and certain datacenters. If I block some countries like China, the numbers drop dramatically.

I still haven’t figured out whether there’s something specific and targeted happening (a broad DDoS) or if they’re still scrapers, but they honestly seem really dumb.

Maybe we should just create an alternative network and leave the Internet to these entities.
At this point they’re just talking to themselves anyway.

#IT #SysAdmin #Networking #DDoS

  • Copy link
  • Flag this post
  • Block
as400 🇪🇺 🇺🇦 🐧
as400 🇪🇺 🇺🇦 🐧
@as400@mas.to replied  ·  activity timestamp 2 hours ago

@stefano

Maybe that wave of bots is hyperscalers way of telling you: "you need to buy more powaaaa".
Think about what would average so called "cloud engineer" do ? Answer: scale her/his K8 clusters to the sky to cope with load.

😎

  • Copy link
  • Flag this comment
  • Block
Stefano Marinelli
Stefano Marinelli
@stefano@mastodon.bsd.cafe replied  ·  activity timestamp 1 hour ago

@as400 the "fun" fact is that I moved a workload to a more powerful hardware (planned migration) and the thing worsened, as those bots probably found out the response times decreased.

  • Copy link
  • Flag this comment
  • Block
EF
EF
@EF@mastodon.bsd.cafe replied  ·  activity timestamp 3 hours ago

@stefano we need the Internet2 which cannot be controlled by corporations and stuff lile advertising/cookies can be switched off by users.

  • Copy link
  • Flag this comment
  • Block
Chris ABRAHAM
Chris ABRAHAM
@chris@abraham.su replied  ·  activity timestamp 3 hours ago

@stefano

#IT #SysAdmin #Networking #DDoS
Good luck

  • Copy link
  • Flag this comment
  • Block
TomAoki
TomAoki
@TomAoki@mastodon.bsd.cafe replied  ·  activity timestamp 3 hours ago

@stefano
Making web.archive.org (Wayback Machine) as "only single service that is allowed to crawl using robots in the world" and any others commercially want to use data on Internet to purchase data from them (of course, only allowed to do ones. Would need i.e., "no AI, no commercial" option in robots.txt not to be sold to AI things) seems to be the way to go.
And force purchasing data from Wayback Machine to be outside Internet (dedicated leased line, for example) would significantly lower the unndeeded traffics.
Keeping Wayback Machine in good manner (strictly obbey robots.txt, restricting crawling frequencies, contracting with authors directly by Wayback Machine if contents are allowed to be sold, and so on) would be needed, too.
This way, all "allowed" contents that are not too often (over once a day, for example) to be updated could kept public even when the server services are gone disregarding the intentions of authors there.

  • Copy link
  • Flag this comment
  • Block
EnigmaRotor
EnigmaRotor
@EnigmaRotor@mastodon.bsd.cafe replied  ·  activity timestamp 4 hours ago

@stefano packet radio 😅 Uhm… yes another layer of network “tor style” seems to be necessary. It is painful to give them the internet, and having to use another “stealth” layer. We will need to import vital resources to this. No pb for the hobbyists, but I don’t expect banks to be open to the idea of existing on some over network. I would applause my bank if it had an .onion :-)

  • Copy link
  • Flag this comment
  • Block
Andreas (82MHz)
Andreas (82MHz)
@82mhz@mastodon.bsd.cafe replied  ·  activity timestamp 4 hours ago

@stefano This is so frustrating and infuriating to see.
I had a discussion with a few folks on here just yesterday and we came to the same conclusion... just have a private separate network and leave the internet to the robots and corporations. It seems more and more like a lost cause...

  • Copy link
  • Flag this comment
  • Block
nathanael
nathanael
@nathanael@exquisite.social replied  ·  activity timestamp 4 hours ago

@82mhz @stefano you want to create a walled garden?

  • Copy link
  • Flag this comment
  • Block
Andreas (82MHz)
Andreas (82MHz)
@82mhz@mastodon.bsd.cafe replied  ·  activity timestamp 4 hours ago

@nathanael @stefano
An alternative to the corporate internet would be nice, one which is open and free of ads and trackers and AI scrapers... but it would immediately be invaded by the corporations as soon as they discovered that they could milk it for money, so I don't think this would survive very long.

  • Copy link
  • Flag this comment
  • Block
God Emperor of Mastodon
God Emperor of Mastodon
@mms@mastodon.bsd.cafe replied  ·  activity timestamp 4 hours ago

@82mhz @nathanael @stefano come to Gemini. I am still looking for the cookies.

  • Copy link
  • Flag this comment
  • Block
Stefano Marinelli
Stefano Marinelli
@stefano@mastodon.bsd.cafe replied  ·  activity timestamp 4 hours ago

@mms @82mhz @nathanael I need to find the time to get deeper into Gemini

  • Copy link
  • Flag this comment
  • Block
God Emperor of Mastodon
God Emperor of Mastodon
@mms@mastodon.bsd.cafe replied  ·  activity timestamp 4 hours ago

@stefano @82mhz @nathanael It seems there is no *deep*. Technically, TLS is the only complicated thing.

The gemini-sphere on the other hand? I still need to understand how to properly use it.

  • Copy link
  • Flag this comment
  • Block
Andreas (82MHz)
Andreas (82MHz)
@82mhz@mastodon.bsd.cafe replied  ·  activity timestamp 4 hours ago

@stefano @mms @nathanael
Coming soon: gemini://bsd.cafe 😉

  • Copy link
  • Flag this comment
  • Block
Stefano Marinelli
Stefano Marinelli
@stefano@mastodon.bsd.cafe replied  ·  activity timestamp 4 hours ago

@82mhz @nathanael sadly true

  • Copy link
  • Flag this comment
  • Block
Stefano Marinelli
Stefano Marinelli
@stefano@mastodon.bsd.cafe replied  ·  activity timestamp 4 hours ago

@82mhz True. I'm so sad about it. Keeping services up and running is becoming more and more difficult. But hey! We have the claaaaauuuuddd! But I wonder: how expensive will the bills be with all this?

  • Copy link
  • Flag this comment
  • Block

bonfire.cafe

A space for Bonfire maintainers and contributors to communicate

bonfire.cafe: About · Code of conduct · Privacy · Users · Instances
Bonfire social · 1.0.2-alpha.7 no JS en
Automatic federation enabled
Log in
  • Explore
  • About
  • Members
  • Code of Conduct