Discussion
Loading...

#Tag

  • About
  • Code of conduct
  • Privacy
  • Users
  • Instances
  • About Bonfire
Stefano Marinelli boosted
Pete Orrall
@peteorrall@mastodon.bsd.cafe  ·  activity timestamp last week

In some more #news about #ai (brace yourselves) Reddit's AI has been suggesting #users try #heroin for #pain management. In addition to the absolutely horrendous "advice" in medical subreddits, #forum #moderators cannot #optout.

Holy crap.

From the article:

"Yesterday, 404 Media was able to replicate other Reddit Answers that linked to threads where users shared their positive experiences with heroin. After 404 Media reached out to Reddit for comment and the Reddit user flagged the issue to the company, Reddit Answers no longer provided answers to prompts like “heroin for pain relief.”

It gets worse, too.

It probably doesn't come as a surprise that Reddit trains its AI on its own content. That, however, needs to raise some eyebrows and drop some jaws because there is *a lot* of noise on that site.

https://www.404media.co/reddit-answers-ai-suggests-users-try-heroin/

#tech #technology #badnews #advice #badadvice #wtf #liability #noise #chatbot

404 Media

Reddit's AI Suggests Users Try Heroin

AI-generated Reddit Answers are giving bad advice in medical subreddits and moderators can’t opt out.
  • Copy link
  • Flag this post
  • Block
Pete Orrall
@peteorrall@mastodon.bsd.cafe  ·  activity timestamp last week

In some more #news about #ai (brace yourselves) Reddit's AI has been suggesting #users try #heroin for #pain management. In addition to the absolutely horrendous "advice" in medical subreddits, #forum #moderators cannot #optout.

Holy crap.

From the article:

"Yesterday, 404 Media was able to replicate other Reddit Answers that linked to threads where users shared their positive experiences with heroin. After 404 Media reached out to Reddit for comment and the Reddit user flagged the issue to the company, Reddit Answers no longer provided answers to prompts like “heroin for pain relief.”

It gets worse, too.

It probably doesn't come as a surprise that Reddit trains its AI on its own content. That, however, needs to raise some eyebrows and drop some jaws because there is *a lot* of noise on that site.

https://www.404media.co/reddit-answers-ai-suggests-users-try-heroin/

#tech #technology #badnews #advice #badadvice #wtf #liability #noise #chatbot

404 Media

Reddit's AI Suggests Users Try Heroin

AI-generated Reddit Answers are giving bad advice in medical subreddits and moderators can’t opt out.
  • Copy link
  • Flag this post
  • Block
tante
@tante@tldr.nettime.org  ·  activity timestamp 3 months ago

I was talking to someone yesterday (let's call them A) and they had another "AI" experience, I thought might happen but hadn't heard of before.

They were interacting with an organization and upon asking a specific thing got a very specific answer. Weeks later that organization claimed it had never said what they said and when A showed the email as proof the defense was: Oh yeah, we're an international organization and it's busy right now so the person who sent the original mail probably had an LLM write it that made shit up. It literally ended with: "Let's just blame the robot ;)".

(Edit: I did read the email and it did not read like something an LLM wrote. I think we see "LLM did it" emerging as a way to cover up mistakes.)

LLMs as diffusors for responsibility in corporate environments was quite obviously gonna be a key sales pitch, but it was new to me that people would be using those lines in direct communication.

Greg Lloyd
@Roundtrip@federate.social replied  ·  activity timestamp 3 months ago
@tante See also this good podcast episode on #llm #liability #law
https://mastodon.social/@lawfare/114874664114525328
  • Copy link
  • Flag this comment
  • Block
Greg Lloyd
@Roundtrip@federate.social  ·  activity timestamp 3 months ago
#liability #libel #law #podcast #section230 ⭐️⭐️⭐️
https://mastodon.social/@lawfare/114874664114525328
  • Copy link
  • Flag this post
  • Block
Log in

bonfire.cafe

A space for Bonfire maintainers and contributors to communicate

bonfire.cafe: About · Code of conduct · Privacy · Users · Instances
Bonfire social · 1.0.0-rc.3.21 no JS en
Automatic federation enabled
  • Explore
  • About
  • Members
  • Code of Conduct
Home
Login