Amazon's internal agentic tool decided that existing code was inadequate and decided to replace it taking down a part of AWS for 13 hours, and was not the first time it had happened. 🤣
https://www.ft.com/content/00c282de-ed14-4acd-a948-bc8d6bdb339d
Daisy Leigh Brenecki
boosted
In today's #AIIsGoingGreat (ht @daedalus) Deloitte charges Newfoundland and Labrador $1.6 million (CAD, presumably) for a report with AI hallucinated citations, and then insists it "stands by its conclusions and findings" and just needs to fix the citations. As ever in these cases, the question of how they came up with the assertions the citations supposedly supported is not addressed
https://theindependent.ca/news/lji/deloitte-breaks-silence-on-n-l-healthcare-report/
* https://mastodon.social/@daedalus@eigenmagic.net/115619136163500955
In today's #AIIsGoingGreat (ht @daedalus) Deloitte charges Newfoundland and Labrador $1.6 million (CAD, presumably) for a report with AI hallucinated citations, and then insists it "stands by its conclusions and findings" and just needs to fix the citations. As ever in these cases, the question of how they came up with the assertions the citations supposedly supported is not addressed
https://theindependent.ca/news/lji/deloitte-breaks-silence-on-n-l-healthcare-report/
* https://mastodon.social/@daedalus@eigenmagic.net/115619136163500955
#AIIsGoingGreat 'Instead, per [District Judge Sara Ellis] footnote, body camera footage revealed that an agent “asked ChatGPT to compile a narrative for a report based off of a brief sentence about an encounter and several images.” The officer reportedly submitted the output from ChatGPT as the report'
https://gizmodo.com/judge-says-ice-used-chatgpt-to-write-use-of-force-reports-2000692370
In today's #AIIsGoingGreat (ht @daedalus) Deloitte charges Newfoundland and Labrador $1.6 million (CAD, presumably) for a report with AI hallucinated citations, and then insists it "stands by its conclusions and findings" and just needs to fix the citations. As ever in these cases, the question of how they came up with the assertions the citations supposedly supported is not addressed
https://theindependent.ca/news/lji/deloitte-breaks-silence-on-n-l-healthcare-report/
* https://mastodon.social/@daedalus@eigenmagic.net/115619136163500955
Ethan Marcotte
boosted
AI is going great.
AI is going great.
Greg Lloyd
boosted
Today's #AIIsGoingGreat, via @Iris: Elsevier "values user experience, hence we develop ways of improving our product" such as having machines invent new, random definitions of terms and attaching them prominently to published papers
https://irisvanrooijcogsci.com/2025/08/12/ai-slop-and-the-destruction-of-knowledge/
Today's #AIIsGoingGreat#ChatGPTLawyer seemed intriguingly steampunk until I realized "Victorian" referred the Australian state, not the historical period https://www.abc.net.au/news/2025-08-15/victoria-lawyer-apologises-after-ai-generated-submissions/105661208
Don't worry, in the glorious #AI future, you'll still have choice! For example, you can choose to have your (or your children's) medical details are filtered through a stochastic bullshit machine, or you can choose to forgo treatment https://ia.acs.org.au/article/2025/kobi-refused-a-doctors-ai-she-was-told-to-go-elsewhere.html
Related to this, I recently discovered that Elsevier uses these AI generated "definitions" on standalone "topic" pages, which rank highly in google. Bonus: The slop is free, but the articles referenced are of course frequently paywalled. Example https://www.sciencedirect.com/topics/engineering/air-fuel-ratio
(this particular definition seems OK, if extremely basic)
Today's #AIIsGoingGreat#ChatGPTLawyer seemed intriguingly steampunk until I realized "Victorian" referred the Australian state, not the historical period https://www.abc.net.au/news/2025-08-15/victoria-lawyer-apologises-after-ai-generated-submissions/105661208
Today's #AIIsGoingGreat, via @Iris: Elsevier "values user experience, hence we develop ways of improving our product" such as having machines invent new, random definitions of terms and attaching them prominently to published papers
https://irisvanrooijcogsci.com/2025/08/12/ai-slop-and-the-destruction-of-knowledge/
"We've solved raspberry and now if we can just fix blueberry, I swear AGI is RIGHT AROUND THE CORNER. Throw another hundred billion on the bonfire!"
https://kieranhealy.org/blog/archives/2025/08/07/blueberry-hill/
Bonus #AIIsGoingGreat "OpenAI announced an agreement to supply more than 2 million workers for the US federal executive branch access to ChatGPT and related tools at practically no cost: just $1 per agency for one year" - OK, they're obviously trying to get people at the agencies hooked so the they'll cough up real money next year, but that also doesn't exactly scream a product so revolutionary and transformative that everyone wants it
#AIIsGoingGreat: AI "news" sites hallucinating killer asteroids (I remember the good old days when we had to rely on British tabloids artisanally hand crafting this kind of idiocy) https://groups.io/g/mpml/topic/2023_af23/114383041
David Gerard
boosted
This from @davidgerard is a great illustration of how vibe coding (like other LLM AI applications) is gonna be a lot less attractive if the AI startups get past the "set investor money on fire to make the number go up" phase before the bubble pops. Crap code done quick and cheap is a legitimate trade for some use cases, but much less so if you lose the cheap part.
https://pivot-to-ai.com/2025/07/09/cursor-tries-setting-less-money-on-fire-ai-vibe-coders-outraged/
This from @davidgerard is a great illustration of how vibe coding (like other LLM AI applications) is gonna be a lot less attractive if the AI startups get past the "set investor money on fire to make the number go up" phase before the bubble pops. Crap code done quick and cheap is a legitimate trade for some use cases, but much less so if you lose the cheap part.
https://pivot-to-ai.com/2025/07/09/cursor-tries-setting-less-money-on-fire-ai-vibe-coders-outraged/
For today's #AIIsGoingGreat I'll just quote this anonymous UN workshop participant "Why would we want to present refugees as AI creations when there are millions of refugees who can tell their stories as real human beings?"
This from @davidgerard is a great illustration of how vibe coding (like other LLM AI applications) is gonna be a lot less attractive if the AI startups get past the "set investor money on fire to make the number go up" phase before the bubble pops. Crap code done quick and cheap is a legitimate trade for some use cases, but much less so if you lose the cheap part.
https://pivot-to-ai.com/2025/07/09/cursor-tries-setting-less-money-on-fire-ai-vibe-coders-outraged/
Jan Lehnardt :couchdb:
boosted
"Supabase MCP can leak your entire SQL database"
This truly fulfills the AI dream: no more need to know SQL to do SQL injections, no more need to use JavaScript to do XSS - it's all vibes. #AIisgoinggreat
"Supabase MCP can leak your entire SQL database"
This truly fulfills the AI dream: no more need to know SQL to do SQL injections, no more need to use JavaScript to do XSS - it's all vibes. #AIisgoinggreat
In today's #AIIsGoingGreat (HT @normative.bsky.social) an intrepid #ChatGPTLawyer finally won based on an apparently slop-filled filing. Unfortunately for them, the opposing party noticed and appealed, to which our budding prompt engineer responded with… another slop-filled filing to the appeals court. The appeals court was not amused: "we impose a $2,500 frivolous motion penalty on Lynch, which is the most the law allows"
https://caselaw.findlaw.com/court/ga-court-of-appeals/117442275.html#
https://mastodon.social/@normative.bsky.social@bsky.brid.gy/114795731130848546
Bonus #AIIsGoingGreat (HT @davidgerard) pricey Springer AI book is chock full of apparently hallucinated citations. Declining to say if they used AI, author responds "reliably determining whether content (or an issue) is AI generated remains a challenge, as even human-written text can appear ‘AI-like.’ This challenge is only expected to grow, as LLMs … continue to advance in fluency and sophistication" - which itself smacks of LLM slop to me
https://mastodon.social/@davidgerard@circumstances.run/114778963476401397