24
submitted 8 months ago by jonuno@slrpnk.net to c/technology@slrpnk.net

cross-posted from: https://slrpnk.net/post/6839374

Fad or relevant?

you are viewing a single comment's thread
view the rest of the comments
[-] mozz@mbin.grits.dev 10 points 8 months ago* (last edited 8 months ago)

Hm, I was a little bit wrong about it -- you're right, AI is basically nothing right now. Here's a report with more.

  • All data centers put together use about 2% of global electricity demand
  • Cryptocurrency is almost a quarter of that
  • AI is basically none of that right now, but likely to rise to be competitive with cryptocurrency in the pretty near future as it gets wider and wider adoption.
[-] Xtallll 6 points 8 months ago

AI isn't inherently more energy demanding than any other program, most crypto is designed to be as inefficient as possible.

[-] mozz@mbin.grits.dev 2 points 8 months ago

It is, though. Most computer tasks that a company does on behalf of their customers can be done with a little handful of web servers, all the way up until you get to Google's scale of operations or something. The reason is that the actual computation the computers are doing is measured in milliseconds on one share of the multicore CPU. AI requires dedicated computing hardware and runs for much longer than that, which means the investment in equipment and how much of it you have to have is orders of magnitude larger. And training the model often takes a whole cluster or data center if you're going to be a serious AI company. You go from needing 10-20 computers even at Reddit's scale or something, to needing hundreds or thousands.

You're right that it's not some sort of magic computation that's harder or more expensive than other computation, it's just that it's unusual (until now) to build out a whole data center that's devoted to doing expensive pure computations on specialized hardware on behalf of your customers, and that's gonna have an impact on how much power your operation consumes.

this post was submitted on 18 Feb 2024
24 points (100.0% liked)

Solarpunk technology

2367 readers
51 users here now

Technology for a Solar-Punk future.

Airships and hydroponic farms...

founded 2 years ago
MODERATORS