242
you are viewing a single comment's thread
view the rest of the comments
[-] HAL_9_TRILLION@lemmy.dbzer0.com 6 points 4 days ago

I actually have a 3B running on my Home Assistant, an 8th gen NUC with 16G of RAM I got for $175. It's quite snappy... if not terribly correct about everything. It's capable of running an 8B but then the response time on the Voice PE is too slow to suit me (goes from 3 seconds to about 8 seconds).

[-] somegeek@programming.dev 1 points 3 days ago
[-] HAL_9_TRILLION@lemmy.dbzer0.com 2 points 3 days ago* (last edited 3 days ago)
[-] somegeek@programming.dev 2 points 3 days ago

Can it be used for agentic workflows or just simple Q and A?

[-] HAL_9_TRILLION@lemmy.dbzer0.com 1 points 3 days ago

Yeah that's why I'm running it. Couldn't get reminders to work with all the possible permutations of time notation without an LLM. It still doesn't fully work properly but it's good enough and it has the side effect that it can answer any question you ask, for better or for worse. It gets simple things right more than half the time I'd say.

I'm keeping my fingers crossed that the work being done by groups like GLM will allow something smarter to run on this hardware within the next year or so.

this post was submitted on 14 Jul 2026
242 points (100.0% liked)

Programmer Humor

32333 readers
1092 users here now

Welcome to Programmer Humor!

This is a place where you can post jokes, memes, humor, etc. related to programming!

For sharing awful code theres also Programming Horror.

Rules

founded 3 years ago
MODERATORS