In preparation for the Reddit June 12-14 Black-out (sh.itjust.works)

submitted 1 year ago* (last edited 1 year ago) by TheDude@sh.itjust.works to c/main@sh.itjust.works

61 comments fedilink hide all child comments

As the reddit mods gets ready for the June 12-14 black-out, there some anticipation that an influx in user base will shift over to many of the lemmy instances as user seek out a home to post their internet memes and discuss their interests.

In anticipation of this increased volume I will be growing our current instance from

16 CPU
8 GB ram

24 CPU
64 GB ram

This server is currently equipped with SSDs that are configured in a raid 10 array (NVMEs will come in the next gen that get deployed)

Earlier today I also configured some monitoring that I'll be watching closely in order to have a better understanding on how the lemmy platform does under stress (for science!)

I'll be sharing graphs and some other insights in this thread for everyone that is interested. Feel free to ask anything you might be interested in knowing more of!

EDIT: I'll be posting and updating the graphs in this main post periodically! Last updated: 6:21AM ET June 12th

CPU - 48 hours

Memory - 48 hours

Network - 48 hours

Load Average - 48 hours

System Disk I/O - 48 hours

top 50 comments

sorted by: hot top controversial new old

[-] ArtisanalRuntime@sh.itjust.works 31 points 1 year ago

For the icon: How about a Satisfied Seal? Because when sh.itjust.works, you know that feel! satisfied_seal

[-] TheDude@sh.itjust.works 12 points 1 year ago

I love this!

[-] ArtisanalRuntime@sh.itjust.works 9 points 1 year ago

Here’s a link to the SVG of the Satisfied Seal so you can tweak as needed. I’ll also post the link in the comment thread. Glad people seem to like it!

https://svgshare.com/s/u8T

[-] ArtisanalRuntime@sh.itjust.works 9 points 1 year ago

Let me know if you want me to tweak the design any and I can send an SVG as well. No copyright/usage restrictions - free to use or modify as you wish.

[-] httpjames@sh.itjust.works 6 points 1 year ago

Thanks for the transparency

[-] nutomic@lemmy.ml 5 points 1 year ago* (last edited 1 year ago)

Impressive setup! Would you be interested to have your instance recommended on the Lemmy project website?

https://lemmy.ml/post/1171717

[-] TheDude@sh.itjust.works 2 points 1 year ago

That would be great! I checked your link and will work on completing the steps shortly :)

[-] Acheron@sh.itjust.works 2 points 1 year ago

Just joined you from that featured site, it just works. People are complaining about how hard it is to switch, I genuinely don’t know what the difficulty is

load more comments (4 replies)

[-] noodle@sh.itjust.works 1 points 1 year ago

let's goo! Great instance that deserves some growth! 🚀

[-] god@sh.itjust.works 2 points 1 year ago

Joined from recommended a bit less than an hour ago. Tried lemmy.ml, got rejected, went for this one cuz it was top recommended and I figured with the name and the user count the likelihood of rejection was smaller.

[-] carrot@sh.itjust.works 5 points 1 year ago

shit just works

[-] phase_change@sh.itjust.works 5 points 1 year ago

I’d love to see a few additional charts with the next update:

Disk space consumed
Subscribers
Communities federated

My guess is that’s not available vie SNMP for Librenms. :)

[-] TheDude@sh.itjust.works 9 points 1 year ago

I'm being a little private about the total amount of disk assigned to this instance for now. I do plan on sharing these details when I have implemented a viable solution. That being said I can tell you that with the amount of current users and activities this instance is growing by about 20GB per day in disk size.

[-] LetterboxPancake@sh.itjust.works 5 points 1 year ago

Holy shit... You tell us when you'll accept donations, right? This doesn't have to be your financial responsibility.

Or do you and I just haven't found it yet?

[-] TheDude@sh.itjust.works 4 points 1 year ago

Not taking donations at the moment. Still need to figure out the best way to collect donations and haven't had the chance to think about it! I will eventually

[-] LetterboxPancake@sh.itjust.works 1 points 1 year ago

No pressure :-)
And thank you for this <3

[-] lightrush@lemmy.ca 4 points 1 year ago

Is this an actual bare metal machine?

[-] TheDude@sh.itjust.works 3 points 1 year ago

No its on a vm.

[-] lightrush@lemmy.ca 3 points 1 year ago

Which cloud?

[-] TheDude@sh.itjust.works 7 points 1 year ago

It's on colocated hardware that I have in a local datacenter.

[-] lightrush@lemmy.ca 4 points 1 year ago

Colo - very nice.

[-] Condodog@sh.itjust.works 3 points 1 year ago

Just discovered this place. Nice to see you guys are getting ready for the influx of users.

[-] pigeonholedpoetry@sh.itjust.works 2 points 1 year ago

Any recommendations on VPS hosts. Thinking about creating my own.

[-] TheDude@sh.itjust.works 1 points 1 year ago

There are many to choose from. Where are you located?

load more comments (4 replies)

[-] TheDude@sh.itjust.works 2 points 1 year ago* (last edited 1 year ago)

A little update for all of you interested. I allocated the additional resources to the VM and will post some updated graphs once they update with the new configurations.

For those who are like me and like looking at graphs here are some prior to the upgrade.

CPU - 48 hours

Memory - 48 hours

Network - 48 hours

[-] this@sh.itjust.works 1 points 1 year ago

so if I'm reading this right, less than 10% CPU capacity and about 1/8th ram at peak times, before upgrades? gotta give you credit where it's due, that thing looks ready to take some abuse.

[-] Srootus@sh.itjust.works 1 points 1 year ago

Hello Lemmy! I've just made an account to get my foot in the door incase the Reddit execs don't roll back after the blackout, let's sit back and watch the fireworks.

[-] Dhrun@sh.itjust.works 2 points 1 year ago

Yeah I'm trying Lemmy anticipating that Relay Pro may stop working soon. Searched for my sub reddit subjects, seemed to work though some of them seem a bit empty so far.

[-] borari@sh.itjust.works 2 points 1 year ago

I’m starting to get random 500’s, I guess that’s a sign I need to go to bed and let the server breathe lol. Can’t wait for the updated graphs!

[-] TheDude@sh.itjust.works 5 points 1 year ago

Looks like it was related to a setting that needed to be tuned. I just updated the graphs. Server is not on fire yet!

[-] borari@sh.itjust.works 1 points 1 year ago

Awesome, great to hear it!

[-] smorks@sh.itjust.works 1 points 1 year ago

oooh pretty colors!

[-] pax@sh.itjust.works 1 points 1 year ago

I am from reddit migration. it's 100000000000 times better, e.g. more accessible with my screenreader, on reddit, I needed to use special app, called dystopia which handled voiceover more gracefully.

[-] sexy_peach@feddit.de 1 points 1 year ago

damn that's good to hear

[-] poVoq@slrpnk.net 1 points 1 year ago

The monitoring is with Prometheus / Grafana? Can you share your setup?

[-] TheDude@sh.itjust.works 1 points 1 year ago

Prometheus /grafana would be great but I'm using an existing librenms setup via snmp probing

[-] PCChipsM922U@sh.itjust.works 1 points 1 year ago

Can this thing run on a Pi clone with 4GB RAM and 4 cores?

[-] TheDude@sh.itjust.works 1 points 1 year ago

It can definitely run on a Pi instance. The storage medium is going to be important as it will need to house a PostgreSQL database. Would be fine for a few users but not sure how many it would be able to handle concurrently.

[-] PCChipsM922U@sh.itjust.works 1 points 1 year ago

It's got 4 cores at 2.16GHz (I think 🤔), 4GB of RAM. Regarding the storage, that can be arranged. Currently there's a 32GB SD card in it, it can be swapped for a 512GB one, no prolem.

So, how many users can an instance on a Pi like that serve?

[-] TheDude@sh.itjust.works 1 points 1 year ago

My biggest concern with your setup is the SD card. SD cards aren't typically known for their write durability. There is a way to use a SSD drive instead however its been a while since I checked the pi stats and might limited at speeds of usb 2. You'll be fine for a small amount of users but you're going to hit a bottleneck pretty quickly if you make your instance open to all.

load more comments

this post was submitted on 07 Jun 2023

25 points (100.0% liked)

sh.itjust.works Main Community

7694 readers

1 users here now

Home of the sh.itjust.works instance.

founded 1 year ago

MODERATORS

TheDude@sh.itjust.works

manifex@sh.itjust.works

biela@sh.itjust.works

imaqtpie@sh.itjust.works