Discussion
Loading...

Post

Log in
  • About
  • Code of conduct
  • Privacy
  • Users
  • Instances
  • About Bonfire
Jürgen Hubert
Jürgen Hubert
@juergen_hubert@mementomori.social  ·  activity timestamp 2 weeks ago

So, how _can_ the #Fediverse protect itself against malicious swarms of agentic #AI and #LLM , like this article describes? How can we protect ourselves from bad actors trying to sway public opinion in this manner?

We do have an advantage here because such swarms cannot easily manipulate the underlying feed algorithms - most (though not all) of the Fediverse does not have any such algorithms other than a strict timeline feed. But this advantage does not confer immunity.

I think we haven't seen many of these attacks on the Fediverse because the Fediverse is ultimately too obscure to matter much to the attackers. But "Security by Obscurity" is not a great design philosophy, either. Besides, I do want the Fediverse to have a growing user base - but that would mean that the Fediverse would become more tempting for attackers.

In the long run, we might have to defederate Open Registration instances, as these are the most likely to attract bad actors. Indeed, we are already seeing things like this on a smaller scale with Mastodon.social. Yet we also need a good entry point to the Fediverse for newcomers.

What are your thoughts on this?

#FediAsk
https://arxiv.org/html/2506.06299v4

How malicious AI swarms can threaten democracy The fusion of agentic AI and LLMs marks a new frontier in information warfare.

  • Copy link
  • Flag this post
  • Block
Ratsnake Games
Ratsnake Games
@ratsnakegames@mastodon.social replied  ·  activity timestamp 2 weeks ago

@juergen_hubert Forcing every user to go through a manual approval process is going to completely ruin the new user experience. It is a horrible idea.

  • Copy link
  • Flag this comment
  • Block

bonfire.cafe

A space for Bonfire maintainers and contributors to communicate

bonfire.cafe: About · Code of conduct · Privacy · Users · Instances
Bonfire social · 1.0.2-alpha.7 no JS en
Automatic federation enabled
Log in
  • Explore
  • About
  • Members
  • Code of Conduct