61
submitted 1 month ago* (last edited 1 month ago) by slazer2au@lemmy.world to c/sysadmin@lemmy.world

AWS Us-east-1 has broken itself on a European Monday morning.

So far we have Slack being slow and image attachments preview broken.

No SSO auth with Atlassian (JIRA, OpsGenie, and Confluence)

Sadly, I looks to be resolving. Back to work 🥲

top 17 comments
sorted by: hot top controversial new old
[-] ramble81@lemmy.zip 12 points 1 month ago

My former company wouldn’t let me rearchitect our apps to be regionally redundant because “the cloud never goes down”. All their stuff is in us-east-1… wonder how they’re doing!

[-] Reygle@lemmy.world 6 points 1 month ago

Having the day they paid to have. Beautiful.

[-] Zorsith 3 points 1 month ago

Hasn't us-east-1 had major outages like, multiple times?

[-] ramble81@lemmy.zip 6 points 1 month ago

It has, and I’ve been told “it’s a fluke” or “it’s not worth the effort”, followed by them freaking out with us being down and all the money we’re losing and what can we do about it.

[-] Egonallanon@feddit.uk 10 points 1 month ago

So far we've got atlassian and our HR system being broken. But we're mostly CCP and azure for our dev stuff so that's all fine.

[-] toynbee@lemmy.world 5 points 1 month ago
[-] slazer2au@lemmy.world 3 points 1 month ago

I know that feeling mate.

[-] Trying2KnowMyself 5 points 1 month ago
[-] AlexisFR@jlai.lu 3 points 1 month ago* (last edited 1 month ago)

OpenVNO telephony despite us being in France.

Also Reddit, it's still a major work tool haha.

[-] AA5B@lemmy.world 3 points 1 month ago

Of all things, we lost some Azure services the longest. There was some unexpected dependency in our code on aws us-east-1 and the azure services didn’t recover

[-] Treczoks@lemmy.world 3 points 1 month ago

So far, nothing. We have our servers in-house.

[-] slazer2au@lemmy.world 3 points 1 month ago
[-] Treczoks@lemmy.world 2 points 1 month ago

I did my part!

[-] clay_pidgin@sh.itjust.works 3 points 1 month ago

Slack working but full of opsgenie alerts.

[-] Valmond@lemmy.world 2 points 1 month ago

Firefox doesn't let you use port 6000 to connect to things.

Why?!

Gotta change to a higher value I guess.

[-] slazer2au@lemmy.world 1 points 1 month ago
[-] Valmond@lemmy.world 2 points 1 month ago

Other ports too, so it's probably ranges.

Back in the day you stayed out of ports under 1024 and that was it.

this post was submitted on 20 Oct 2025
61 points (100.0% liked)

Sysadmin

11896 readers
1 users here now

A community dedicated to the profession of IT Systems Administration

No generic Lemmy issue posts please! Posts about Lemmy belong in one of these communities:
!lemmy@lemmy.ml
!lemmyworld@lemmy.world
!lemmy_support@lemmy.ml
!support@lemmy.world

founded 2 years ago
MODERATORS