188
Ed Zitron announced an insider story that might blow up the AI grift
(discuss.tchncs.de)
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.
There's one company trying to etch models into the silicon, they got a working prototype in a 8b model and it does 17k t/s. They suggest at data center scales with bigger models it'd pay for itself in a year in saved costs in electricity, cooling, space required etc.
You can apply lora's to it, but it will fall behind as it ages, im not quite sure how long a static model would last to make up the money after that 1st year, but for something like creative writing where it doesnt need current data (e.g programming but the languages are always changing and evolving is a problem) it might work?
I expect a slowdown in that regard anyway. As a lot of new code is heavily LLM generated anyway, it's recycling "the same old shit" all the way down.
Languages are updated constantly. Its not like Python was created and never changed after that. You'd he stuck on whatever the latest version was when it got etched into the silicon.