Kinda cool that if you were reasonably wealthy, you could spend around 100k on compute and have something with similar performance to Opus running entirely locally.
You can get there a lot cheaper than 100k. You just need a machine good enough to run Qwen 3.6 27b, and use a good coding harness.
There's no comparison between qwen 3.6 / these models though. Not even close.
Not on its own, but take a look at the benchmarks for ATLAS. It does some clever tricks to compensate for the capabilities of the smaller model, so it ends up punching far above its weight. One key trick they use is to have the model produce a few shots, and then use a small and fast model to do a heuristic to score which ones are promising. And turns out that dramatically improves the quality of the output.
Without nagging restrictions like “press continue” from time to time? I would enjoy it more than a similarly priced Lamborghini
Where do you get a Lamborghini for just 100k?
Might even draw less power than a lambo
This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.
Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.
Rules:
1: All Lemmy rules apply
2: Do not post low effort posts
3: NEVER post naziped*gore stuff
4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.
5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)
6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist
7: crypto related posts, unless essential, are disallowed