76
I'm using AI and I feel terrible now
(lemmy.world)
Privacy has become a very important issue in modern society, with companies and governments constantly abusing their power, more and more people are waking up to the importance of digital privacy.
In this community everyone is welcome to post links and discuss topics related to privacy.
much thanks to @gary_host_laptop for the logo design :)
You don't actually have to have a beefy computer to self host. I know with deepseek there's a 1.5b model which is optimized for low end hardware. I self hosted it on a desktop from 2012 and it worked alright. 8gb RAM, i5 processer, quad core. Was the GPU usage high? Yep. Still worked tho.
Obligatory: you're not running deepseek 1.5B. You're running some other distilled model which was finetuned by the deepseek folks
Wait, what? How does that work?
Deepseek 1.5B doesn't exist. I don't know why the Deepseek team named the models on Huggingface like this, but what is labelled as "Deepseek 1.5B" is actually not the OG Deepseek 70B model distilled to 1.5B, it's a different model either trained or finetuned by the Deepseek team. My theory is some sort of intentional manipulation on their part so people stay confused on whether they are actually running the Deepseek model or not. There is a lot of commentary on this online, sorry I don't have the links from the top of my head.
Oh wow, that’s awesome. I’m gonna have to try that model out. I have an old XFX 7950 I can try burning out lmao.