27
submitted 5 months ago by hisao@ani.social to c/technology@lemmy.world
top 5 comments
sorted by: hot top controversial new old
[-] jeena@piefed.jeena.net 14 points 5 months ago

I tried the 20b on my PC with ollama and Open WebUI and I have to say for some of my use cases it preforms similar to the online version, I was impressed.

[-] thoon@feddit.nl 13 points 5 months ago

Finally, their company name is starting to make SOME sense

[-] nymnympseudonym@lemmy.world 7 points 5 months ago

It's awesome but that 128k context window is a throwback to Llama3 days

I bet the closed $ource model has like 2MB context

[-] fubarx@lemmy.world 2 points 4 months ago

Ran the 20B on a Mac under LMStudio. Pretty zippy and did OK on basic coding tasks.

[-] Mwa@thelemmy.club 1 points 5 months ago

Crazy but sure ig

this post was submitted on 06 Aug 2025
27 points (100.0% liked)

Technology

78305 readers
3613 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS