13

So with Crypto mining being less profitable and miners selling their rigs for cheap I thought how can I get my self a cheap managed network switch. I saw mining motherboards with 12 PCIe 2.0 1x slots(4gbit bandwidth) and tought hey if I plug in some cheap 10g 2port network adapters I can make my own network switch with exactly the ports I need(SFP+ rj45). Put opensence on it and boom Managed network switch with multigig(2gbit per port). Is there something I am missing or have I found a way to get cheap multigig? Also can anyone who has a 10g only network switch tell me what kind of power it is using per port so I can compare? Thanks for debunking my idea and saving me a few bucks.

you are viewing a single comment's thread
view the rest of the comments
[-] lemann@lemmy.one 3 points 1 year ago* (last edited 1 year ago)

Surprised I've never seen this DIY approach mentioned anywhere or thought of it before 🤔 - usually people end up going for those mini PCs that have multiple network cards soldered to the mobo itself

Compared to an actual 10gig switch, the power consumption might be high (unless the network card drivers have been well optimised by the devs, offloading as much traffic handling as possible to the 10gig cards' own CPUs). In this case just make sure you have a powerful enough CPU to handle that traffic, as well as handle that 4gig traffic traveling between the network cards over PCIe.

Some gotchas to look out for though:

  • PCIe lane wiring... are they going straight to the CPU, or are they going via the chipset (or slightly slower, a PCIe switch connected to the chipset). The mobo manual can advise on this, ideally you'd want something with as much PCIe lanes connected to the CPU directly to get the full speed.
  • Power consumption... touched on this earlier but one to be aware of, esp if you live somewhere where electricity is expen$iv€
  • Noise... you might need to buy a fan to cool down the network cards depending on your traffic, and how much the OS driver offloads to your 10gig cards
  • A backup... if you need to do changes to your DIY switch, make sure you have some way of accessing the internet
  • Bridging... there may be an ideal/recommended way to set up bridging for multiple interfaces on the same network card, to take advantage of hardware offloading, allowing you to get 10gig traffic between two devices even though the PCIe lane is just 4gbit
  • Traffic filtering... again just ensure your CPU can handle it, particularly for HTTP traffic. I only do filtering on DNS traffic due to having a weak CPU, works well enough to catch some ad/tracking services that employ nasty tricks to evade blocklists.

I only have 1gig hardware so can't really provide comparisons :( however there's a youtube channel called ServeTheHome that started measuring power consumption of almost all the hardware they test - if they've done 10gig switches recently then that should give you some pointers at least

Edit: fix formatting 🫠

[-] plotting_homelab@lemmy.world 2 points 1 year ago

Okey I see everyone telling me power will be 100w+ so I think I won't do it as we pay around the 30-50 cents per kWh but I see why purpose made hardware is more expensive now

load more comments (1 replies)
this post was submitted on 05 Oct 2023
13 points (100.0% liked)

homelab

6602 readers
1 users here now

founded 4 years ago
MODERATORS