1319
submitted 6 months ago by boem@lemmy.world to c/technology@lemmy.world
you are viewing a single comment's thread
view the rest of the comments
[-] echodot@feddit.uk 2 points 6 months ago* (last edited 6 months ago)

That's true but if you don't mind the fact that the AI can't learn anything new you can actually go hardware optimization routes and get pretty good performance. We're starting to see AI chips being made. They will do for AI what GPUs did for graphics.

However these hardware optimized chips are only for running the AI you still need GPUs for training it. I could see a situation where new models are trained by big companies and then the results are sold to individuals who then buy the packages and install them on local chips.

[-] kaityy 1 points 6 months ago

interesting. are these ai chips actually being released on open markets yet, or are thongs still in development phases?

[-] echodot@feddit.uk 2 points 6 months ago

They're available on the open market but you have to buy them as integrated systems since no especially available motherboard has a socket for them, don't even think there's a standard for a socket. They come soldered to the board which isn't the best because when a better version comes out you basically have to throw everything away and start again.

But in a few years I suspect we'll have proper socketed versions.

this post was submitted on 03 Jun 2024
1319 points (100.0% liked)

Technology

59974 readers
1935 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS