Discussion
Loading...

Post

Log in
  • About
  • Code of conduct
  • Privacy
  • Users
  • Instances
  • About Bonfire
datum (n=1)
datum (n=1)
@datum@zeroes.ca  ·  activity timestamp last month

I feel like the general populace might not realize the importance of this idea that @pluralistic shares:

what Dan Davies calles an "accountability sink." The radiologist's job isn't really to oversee the AI's work, it's to take the blame for the AI's mistakes.

this human (sometimes only nominally) in the loop is central to law as a whole not being broken

it's also of utmost importance for weapons of war, where AI actually is having life and death impact right now, with non-hypotheticals like "how do we make sure the system doesn't kill innocents without repercussions"

because if there's no repercussions the system will end up externalizing on the way to maximizing other metrics

https://pluralistic.net/2025/12/05/pop-that-bubble/

#AI #accountability

https://pluralistic.net

Pluralistic: The Reverse-Centaur’s Guide to Criticizing AI (05 Dec 2025)

  • Copy link
  • Flag this post
  • Block
Rachel
Rachel
@rachel@transitory.social replied  ·  activity timestamp last month

@datum@zeroes.ca @pluralistic@mamot.fr

Moral crumple zones, basically ways to assign blame to replaceable employees or end users
https://estsjournal.org/index.php/ests/article/view/260

  • Copy link
  • Flag this comment
  • Block
Subjacent Banana
Subjacent Banana
@subjacentish@zeroes.ca replied  ·  activity timestamp last month

@datum @pluralistic It's like "self-driving" and "computer controlled aircraft" - they always kill the autopilot the minute there's a problem. Boom. Pilot Error.

That Air France flight was a nice case study. Airplane was on auto pilot, pitot tubes froze and confused the autopilot, autopilot dumps off, sleepy crew has to make quick decision abt what the data means, takes the plane into a death stall. Pilot Error.🤡

https://en.wikipedia.org/wiki/Air_France_Flight_447

  • Copy link
  • Flag this comment
  • Block
Hendrik Pfaff 🇪🇺
Hendrik Pfaff 🇪🇺
@HendrikPfaff@ioc.exchange replied  ·  activity timestamp last month

@datum @pluralistic Pharmaceutical companies in the #EU are required by law to have a "qualified Person" (QP). Their sole purpose is to sign of the entire (incredible complex) manufacturing process of the drugs the company produces every day and take the blame (i.e. get fired) in case of errors or costly product recalls.

Overseeing and signing of #ai processes however, sounds even worse, as it is literally impossible for a person to understand the inner workings of the black box...

  • Copy link
  • Flag this comment
  • Block

bonfire.cafe

A space for Bonfire maintainers and contributors to communicate

bonfire.cafe: About · Code of conduct · Privacy · Users · Instances
Bonfire social · 1.0.1-beta.35 no JS en
Automatic federation enabled
Log in
  • Explore
  • About
  • Members
  • Code of Conduct