1164
submitted 8 months ago* (last edited 8 months ago) by rxxrc@lemmy.ml to c/technology@lemmy.world

All our servers and company laptops went down at pretty much the same time. Laptops have been bootlooping to blue screen of death. It's all very exciting, personally, as someone not responsible for fixing it.

Apparently caused by a bad CrowdStrike update.

Edit: now being told we (who almost all generally work from home) need to come into the office Monday as they can only apply the fix in-person. We'll see if that changes over the weekend...

you are viewing a single comment's thread
view the rest of the comments
[-] sasquash@sopuli.xyz 154 points 8 months ago

never do updates on a Friday.

[-] spyd3r@sh.itjust.works 4 points 8 months ago

Never update unless something is broken.

[-] Toribor@corndog.social 56 points 8 months ago

This is fine as long as you politely ask everyone on the Internet to slow down and stop exploiting new vulnerabilities.

[-] Ookami38@sh.itjust.works 21 points 8 months ago

I think vulnerabilities found count as "something broken" and chap you replied to simply did not think that far ahead hahah

[-] huginn@feddit.it 14 points 8 months ago

For real - A cyber security company should basically always be pushing out updates.

[-] sugar_in_your_tea@sh.itjust.works 4 points 8 months ago

Exactly. You don't know what the vulnerabilities are, but the vendors pushing out updates typically do. So stay on top of updates to limit the attack surface.

Major releases can wait, security updates should be pushed as soon as they can be proven to not break prod.

[-] wreckedcarzz@lemmy.world 1 points 8 months ago

always pushing out updates

Notes: Version bump: Eric is a twat so I removed his name from the listed coder team members on the about window.

git push --force

leans back in chair productive day, productive day indeed

[-] huginn@feddit.it 1 points 8 months ago

git commit -am "Fixed" && git push --force

[-] Passerby6497@lemmy.world 8 points 8 months ago

That's advice so smart you're guaranteed to have massive security holes.

[-] Hotzilla@sopuli.xyz 2 points 8 months ago

This is AV, and even possible that it is part of definitions (for example some windows file deleted as false positive). You update those daily.

[-] merc@sh.itjust.works 3 points 8 months ago

You posted this 14 hours ago, which would have made it 4:30 am in Austin, Texas where Cloudstrike is based. You may have felt the effect on Friday, but it's extremely likely that the person who made the change did it late on a Thursday.

this post was submitted on 19 Jul 2024
1164 points (100.0% liked)

Technology

68526 readers
3165 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS