Post

Log in
About
Code of conduct
Privacy
Users
Instances
About Bonfire

Unnamed TNG skant beefcake

@researchfairy@scholar.social · activity timestamp last year

Reminder that ChatGPT didn't ace the bar exam (old article I know)

GPT-4 didn't ace the bar exam after all, MIT research suggests — it didn't even break the 70th percentile

Last year, claims that OpenAI's GPT-4 model beat 90% of trainee lawyers on the bar exam generated a flurry of media hype. But these claims were likely overstated, a new study suggests. — GPT-4 didn't ace the bar exam after all, MIT research suggests — it didn't even break the 70th percentile Last year, claims that OpenAI's GPT-4 model beat 90% of trainee lawyers on the bar exam generated a flurry of media hype. But these claims were likely overstated, a new study suggests.

Copy link
Flag this post
Block

Replies: 5

Unnamed TNG skant beefcake

@researchfairy@scholar.social · activity timestamp last year

> Google faked Gemini AI output in Super Bowl ad

https://www.theverge.com/news/608188/google-fake-gemini-ai-output-super-bowl

New AI fakery in 2025

The Verge

Google faked Gemini AI output in Super Bowl ad

Gemini didn’t write that incorrect Gouda stat at all.

Copy link
Flag this comment
Block

Unnamed TNG skant beefcake

@researchfairy@scholar.social · activity timestamp last year

> Two biotechs say they’re using AI to conjure drugs from scratch. Their documents suggest otherwise

> Experts are skeptical of the grand claims of startups like Absci and Generate Biomedicines

https://www.statnews.com/2025/02/10/ai-drug-development-claims-by-biotech-companies-absci-generate-biomedicines-questioned/

STAT

Two biotechs say they're using AI to conjure drugs from scratch. Their documents suggest otherwise

A STAT examination shows how AI-powered biotechs like Absci and Generate Biomedicines routinely aggrandize their AI capabilities.

Copy link
Flag this comment
Block

Unnamed TNG skant beefcake

@researchfairy@scholar.social · activity timestamp 12 months ago

Then:

> The paper said that after an AI tool was implemented at a large materials-science lab, researchers discovered significantly more materials—a result that suggested that, in certain settings, AI could substantially improve worker productivity

Now:

> MIT Says It No Longer Stands Behind Student’s AI Research Paper

https://www.msn.com/en-us/money/other/mit-says-it-no-longer-stands-behind-student-s-ai-research-paper/ar-AA1EUFwO

its_a_fake.gif

MSN

Copy link
Flag this comment
Block

Unnamed TNG skant beefcake

@researchfairy@scholar.social · activity timestamp 11 months ago

Huh another AI fake

Almost like there's a pattern

Headline:

Why did Microsoft-backed $1.3bn Builder.ai collapse? Accused of using Indian coders for ‘AI’ work

Over the next eight years, it raised over $445 million, counted Microsoft and the Qatar Investment Authority as investors, and crossed the $1.3 billion valuation mark. By May 2025, it has gone bankrupt.

Written by Gopika Nair
Updated: May 23, 2025 14:38 IST — Headline: Why did Microsoft-backed $1.3bn Builder.ai collapse? Accused of using Indian coders for ‘AI’ work Over the next eight years, it raised over $445 million, counted Microsoft and the Qatar Investment Authority as investors, and crossed the $1.3 billion valuation mark. By May 2025, it has gone bankrupt. Written by Gopika Nair Updated: May 23, 2025 14:38 IST

Copy link
Flag this comment
Block

~1 more replies

Unnamed TNG skant beefcake

@researchfairy@scholar.social · activity timestamp 2 hours ago

> The Editor has decided to retract this paper owing to concerns regarding discrepancies in the meta-analysis. These issues ultimately undermine the confidence the Editor can place in the validity of the analysis and resulting conclusions. The authors have not responded to correspondence regarding this retraction.

https://www.nature.com/articles/s41599-026-07310-z

Copy link
Flag this comment
Block