Thank you! Just to make sure I am following correctly, for your LXC running PBS, it sounds like you used a privileged container on Proxmox itself, right (vs. an LXC on TrueNAS)?

Thanks for this! I guess that settles my case deliberation at least. But man, getting all the things you mentioned for $170 on eBay is crazy good!!! I must just really need to dig in there a bit deeper (it's gonna be too easy to go broke with home networking as a hobby otherwise lol). I guess so long as I am memtesting my RAM and burning in drives right after getting them I should be okay. I think I also am overindexing on trying to get my power draw as low as possible instead of really doing the math out and seeing how long I'd need to be running something 24/7 before the power savings ends up outweighing the price differential. But thanks again!

Thank you! The case rec is super helpful actually, I was considering the Fractal Design Define R5 (though I wasn't sure how to feel about potentially spending the same amount on my motherboard as my case, but people seem to swear by it), so it's great to have confirmation they're actually worth it. I had given PC Part Picker a shot, but it seems like it doesn't quite catch the ECC memory support for some of the AMD systems (maybe because they're unofficial?) I will give it another shot though, and thanks again!

Thanks for this! Agree that coreboot is definitely the requirement that, if dropped, would open up the most other options. So far it sounds like folks are mostly willing to have some faith in stock firmware, which is great as a sanity check for me. Appreciate your response!

Thanks so much! I'd seen Hunsn mentioned in a few places as well, so glad to hear that it's working well (and thanks especially for the memory ballooning tip, I'll try to remember that when I inevitably run into issues later).

(But if you don't mind my asking, what machine did you end up with from CN? How did you approach firmware?)

Thanks for sharing! Will probably try to go this route once I get the NAS squared away and turn back to localLLMs. Out of curiosity, are you using the q4_k_m quantization type?

Wow, that sounds amazing! I think that GPU alone would probably exceed my budget for the whole build lol. Thanks for sharing!

Thanks for flagging this! I'd just passively absorbed second hand the mining rig fears, but you're totally right that it's not as though a regularly used overclocked gaming GPU isn't going to also be subject similar degradation (especially if the miner is intentionally underclocking). I guess the biggest fears then are just physical damage from rough install and then potential heat damage (though maybe swapping thermal pads and paste helps alleviate that?) And of course checking benchmarks for any weirdness if possible I guess...

This is super interesting, thanks so much for sharing! In my initial poking around, I'd seen a lot of people that suggested virtualizing TrueNAS within Proxmox was a bit of a headache (especially when something inevitably goes wrong and everything goes down), but I hadn't considered cutting out TrueNAS entirely and just running directly on Proxmox and pairing that virtualization with k8s and robust backups (I am pleasantly shocked that PBS can manage that many backups without it eating up crazy amounts of space). After the other comments I was sort of aligning around starting off with a TrueNAS build and then growing into some of the LLM stuff I mentioned, but I have to admit this is really intriguing as an alternative (even if as something to work towards once I've got some initial prototypes; figuring out k8s would be a really fun project I think). Just out of curiosity, how noisy do you find the old Dell servers? I have been hesitant both because of power draw and noise, but would love to get feedback from someone who has them. Thanks so much again for taking the time to write all of this out, I really appreciate it!

Thanks so much for all of this info! You're almost certainly correct that I'm overthinking this (it's definitely a talent of mine). I had been leaning z2 on the NAS only because I'd heard that the resilvering process can be somewhat intensive on the drives, especially when they're larger, but I had also seen folks say that this was probably overkill for most home settings and so I'm glad someone with experience on it could chime in. I think my biggest takeaway from what you shared is that it sounds like keeping the file system baremetal and fiddling with it as little as possible is the strategy (vs. virtualizing it and running it out of one large Proxmox machine, for instance). And I think you're totally right on the LLMs being the real sticking point; I'd had no idea just how resource intensive they were not just to train but even to operate until I started looking into running one locally. It's honestly making me think that maybe trying to roll this out in phases starting with the NAS (while also doing some other infrastructure upgrades like looking at running cat 6a and swapping out my router from the ISP all-in-one to something that can run OPNSense paired with some WAPs), might be a better place to start. Then, if I can get some early successes under my belt, I can move onto the LLM arena and see how much time, money, and tears I want to spend getting that up and running. Oh, and thanks also for mentioning TiB; it sent me down a very interesting rabbit hole on the base 10 vs. base 2 byte measurement and how drive companies use the difference to pump up the number they get to advertise; I had no idea that accounting for the discrepancy in drive size, but is definitely not surprising.

Thank you! Honestly I am probably going way overboard myself (I think I've tried to convince myself that it might make sense given the likelihood of tariffs around the corner, but honestly might still end up downscaling to more like 10-20TB of storage and radically reduce my LLM expectations). And thanks also for the Crafty Controller rec, I hadn't heard of them and will definitely check them out!