Discussion
Loading...

Post

  • About
  • Code of conduct
  • Privacy
  • Users
  • Instances
  • About Bonfire
Jonathan Schofield
@urlyman@mastodon.social  ·  activity timestamp 11 hours ago

We’re taking

1. the *most extreme purity* ever engineered in a mass production context and…

2. pushing it into a *rapidly degrading environment* and…

3. building out an entire economy on new levels of *waste* (which feeds back on 2)

“The utilization rates of GPUs for AI workloads in a datacenter run by cloud service providers is between 60% and 70%. With such utilization rates, a GPU will typically survive between one and two years, three years at the most”

https://www.tomshardware.com/pc-components/gpus/datacenter-gpu-service-life-can-be-surprisingly-short-only-one-to-three-years-is-expected-according-to-unnamed-google-architect

  • Copy link
  • Flag this post
  • Block
Joseph Elfelt
@mappingsupport@m.ai6yr.org replied  ·  activity timestamp 7 hours ago

@urlyman Getting harder and harder to think that AI is *not* a bubble.

  • Copy link
  • Flag this comment
  • Block
David Chisnall (*Now with 50% more sarcasm!*)
@david_chisnall@infosec.exchange replied  ·  activity timestamp 8 hours ago

@urlyman

Hmm, with that rapid depreciation, I wonder if you need to count it as OpEx instead of CapEx. If something is consumed during the course of a year, it isn’t capital expenditure.

Requiring companies to declare GPUs as OpEx would kill the bubble immediately.

  • Copy link
  • Flag this comment
  • Block
Toni Aittoniemi
@gimulnautti@mastodon.green replied  ·  activity timestamp 10 hours ago

@urlyman … and all of the ’magnificent 7’ devalue the GPU’s they ”bought” from Nvidia at 5-6 years in their financial reports, when they’ll actually burn out in 1-3 years..

It’s not a bubble at all.

  • Copy link
  • Flag this comment
  • Block
Jonathan Schofield
@urlyman@mastodon.social replied  ·  activity timestamp 11 hours ago

…This is just new levels of stupid

  • Copy link
  • Flag this comment
  • Block
Markus Ojala
@mojala@mastodon.online replied  ·  activity timestamp 11 hours ago

@urlyman And I’m pretty sure no one in the design and production loop of these things give any thought to sustainability or material flows.

  • Copy link
  • Flag this comment
  • Block
Jonathan Schofield
@urlyman@mastodon.social replied  ·  activity timestamp 11 hours ago

@mojala there are people really worried about it. e.g. https://semiengineering.com/ai-power-consumption-exploding/

But there is money to be made in the meantime 🤷‍♂️

  • Copy link
  • Flag this comment
  • Block
Log in

bonfire.cafe

A space for Bonfire maintainers and contributors to communicate

bonfire.cafe: About · Code of conduct · Privacy · Users · Instances
Bonfire social · 1.0.0 no JS en
Automatic federation enabled
  • Explore
  • About
  • Members
  • Code of Conduct
Home
Login