824
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 17 Aug 2026
824 points (100.0% liked)
Technology
87280 readers
2944 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
Question is, how long are they going to keep making their new models open weight? GPT2 was open too, y'know. Hell, the company that made it is called "Open"AI. Money corrupts.
And how many concurrent users do you get with 8 B300s on the Kimi K3? I'm not 100% sure on the math, but apparently about <= 4 with full context size.
They can make these models open weight because basically nobody's gonna be able to run them and you can't just build a brand new model out of it like you can with regular open source software. That 8 nvidia B300 card minimum isn't enough to run it commercially, it's good for like a small 10-20 person company of fairly heavy users, or slightly more if not using heavily.
You say it as if OpenAI started with good intentions and got corrupted by the money. But the most likely explanation is that it was a scam from the start.
I couldn't find anything about concurrency. But I assumed it's more like ~1000 users? B300 has something like 100,000+ tok/s, not sure about context size. I also was wrong on my math for the solar panels, see above. It's more like +50% costs than 10%. Obviously all of this is napkin math, but even 50% isn't too bad. My point is that with a slightly saner rollout of AI there seems to be absolutely no problem to make it sustainable. And if you buy your tokens in China you can select a data center that gets it's power from nuclear or solar.
And yeah we don't know how long they will release open weight models. Once hardware to run such open weight models become available they might change tactics. But right now China releasing these open models has a serious impact on the stock price of these AI companies, which is a good thing. The sooner the AI bubble pops the better.
And like 7 of the top 10 suppliers of tokens right now is from China apparently. What Xi himself said is that the world needs a multilateral approach and AI should not become a monopoly. And while that is clearly propaganda aimed at the global south, China does have a different approach. They spend peanuts on their AI models compared to the west (and the algorithmic breakthroughs done by Chinese AI researches afaik have also been published).
But you actually can use an existing model to generate training data for a new model. Which is what the US corporations are currently accusing China of doing, which is of course hilarious. Of course China has generated huge amounts of training data themselves. So basically any industrial country could in the future fund a research effort to produce a new AI model and make it open weights. A monopoly situation would be another huge issue with AI.
Basically in regulation, sustainability and democratizing access China is doing very good. And in poking the AI bubble.