24
submitted 8 months ago by jonuno@slrpnk.net to c/technology@slrpnk.net

cross-posted from: https://slrpnk.net/post/6839374

Fad or relevant?

you are viewing a single comment's thread
view the rest of the comments
[-] mozz@mbin.grits.dev 2 points 8 months ago

It is, though. Most computer tasks that a company does on behalf of their customers can be done with a little handful of web servers, all the way up until you get to Google's scale of operations or something. The reason is that the actual computation the computers are doing is measured in milliseconds on one share of the multicore CPU. AI requires dedicated computing hardware and runs for much longer than that, which means the investment in equipment and how much of it you have to have is orders of magnitude larger. And training the model often takes a whole cluster or data center if you're going to be a serious AI company. You go from needing 10-20 computers even at Reddit's scale or something, to needing hundreds or thousands.

You're right that it's not some sort of magic computation that's harder or more expensive than other computation, it's just that it's unusual (until now) to build out a whole data center that's devoted to doing expensive pure computations on specialized hardware on behalf of your customers, and that's gonna have an impact on how much power your operation consumes.

this post was submitted on 18 Feb 2024
24 points (100.0% liked)

Solarpunk technology

2367 readers
51 users here now

Technology for a Solar-Punk future.

Airships and hydroponic farms...

founded 2 years ago
MODERATORS