does anybody have really high quality, recent (as in, from this year) numbers on electricity consumption of AI datacenters? why is this shit so hard to find
Post
Replies:
4
@xan I can't speak for power consumption of datacenters, but I Know @mttaggart did some digging into the power cost to train an AI model, and one estimate was 50KW.
Oh yeah, I watched this documentary video once about datacenter noise, and its health effects, and there was very brief blurb on an estimate for the power consumption of the xAI/Grok datacenter:
https://www.youtube.com/watch?v=_bP80DEAbuo
You'll want to watch the third section specifically, starting at ~4:08 to hear power specs for the Colossus datacenter.
@mttaggart @xan I was off by an order of magnitude. whoops.