192
Today's downtime (self.main)
submitted 1 year ago by ada to c/main

Apologies to all for today's performance issues and downtime.

Logging for our lemmy instance filled our main partition and brought everything to a halt. Our lemmy instance shares hardware with blahaj.zone, and the significant growth in lemmy over the last 10 days has caused the logs to grow in size exponentially! As a result of the logs filling up the main partition, both lemmy.blahaj.zone and blahaj.zone itself went down.

We've freed up some space, upgraded the hardware and spun everything up again, and it looks everything is back to normal.

Apologies for the inconvenience, and welcome back to everyone!

you are viewing a single comment's thread
view the rest of the comments
[-] ada 15 points 1 year ago

The real issue is simply that this instance was set up more as experiment initially, with basically 1 user, and suddenly it's got 1500 users. The growth caught us by surprise, and it was never set up with this growth rate in mind. Got it under control now, and we will be keeping an eye on future growth

[-] CrimsonOnoscopy@beehaw.org 4 points 1 year ago

Cool; Good luck!

this post was submitted on 14 Jun 2023
192 points (100.0% liked)

Blahaj Lemmy Meta

2322 readers
1 users here now

Blåhaj Lemmy is a Lemmy instance attached to blahaj.zone. This is a group for questions or discussions relevant to either instance.

founded 2 years ago
MODERATORS