35
submitted 1 day ago* (last edited 1 day ago) by whodatdair to c/dull_mens_club@lemmy.world

Just woke up and made my coffee, found that my migration is complete!

I built a nas when I was fresh out of college with 3 drives in raid5 but because btrfs was relatively new at the time, I decided to go with ext4 for the file system. Essentially it defines how the 1’s and 0’s are arranged on the disk and how reads/writes etc work. Btrfs boasted some neat new features, but I just wanted reliable storage so I went with the established tech. I also left the 4th bay open because drives were expensive as frig at the time.

Now that time has passed and btrfs is more widespread, I found myself missing some of the features like snapshots and copy-on-write, so I decided to both add a hd and convert at the same time.

Only thing is that there isn’t really a way to convert an ext4 drive to btrfs - you have to copy everything off and back on. Some of the files I’ve got I’ve had for more than a decade, so I was understandably terrified of the thought.

I ended up making my new drive in the final bay into a standalone volume which I manually copied everything to, then wrote a bash script to recursively check the hash of every file on both sides to make sure they’re the same. This took 4 days of straight copying and reading/verification.

And cuz I’m a paranoid fek, I repeated the process with an old external drive I bought so I’d have two copies, one on the raid volume and on the external. Less chance of something going wrong on both simultaneously.

Even with two verified copies I had to take a deep breath and think real hard about anything I maybe forgot before I deleted that >10yo volume full of photos, legal docs, etc. Terrifying.

But this morning the restore has finished! Now I just verify the restored files and I can nuke the temporary standalone and add it into the raid cluster, and I’ll have a shiny new ginormous storage volume with all the lovely btrfs features I’ve been reading about.

The nice thing about this project is that I realized that this single drive failure that my raid cluster isn’t really the same as a full separate backup on a separate media. So I’ve left the cheap external that spins down if not accessed and set up a job to spin it up once a night and back anything new or changed to it.

This morning I’m sitting here excited about my objectively dull accomplishment. I think if I explained this to anyone I know irl their eyes would glaze over in the first paragraph, but I’m living my best boring life and it’s fantastic.

top 8 comments
sorted by: hot top controversial new old
[-] Xaphanos@lemmy.world 10 points 1 day ago

Nice info. Helpful. Directly useful and applicable to me. But not really dull. Just not of interest to non-technical folks. Thanks for the post, but in the future you should try to be duller to fit in.

[-] whodatdair 3 points 1 day ago

Ha, my apologies - I wrote it out to be somewhat entertaining to read but in reality I moved some files around in a paranoid way and then reformatted some hard drives…

Most of my friends would glaze over the moment I mentioned file system types 🤣

[-] iii@mander.xyz 11 points 1 day ago

objectively dull accomplishment

Nah it ain't

[-] afk_strats@lemmy.world 6 points 1 day ago

That's so cool. I wasn't brave enough to try btrfs with my storage either. c/Homelab would enjoy this post and I would die to see your copy/verify script

[-] hsdkfr734r@feddit.nl 4 points 1 day ago

Btrfs is great, with copy on write by default and (offline) dedup and subvolumes/ snapshots. No need for LVM and reserving a fixed amount of disk space for a VM.

It adds a lot of complexity and I'm not sure what to do when it breaks (hopefully aunt google will help me then).

[-] Sergio@slrpnk.net 4 points 1 day ago

That is really cool. I've been meaning to set up a NAS for a while -- I just have a bunch of external USB hard drives that I need to get better organized.

[-] harsh3466@lemmy.ml 4 points 1 day ago

That's awesome. I've got my raid on ext4 as well, and have been eyeing btrfs, and am also paranoid about data loss.

[-] R3D4CT3D@midwest.social 3 points 1 day ago

this is in no way dull! thoroughly enjoyed reading through, cheers!

this post was submitted on 20 Dec 2024
35 points (100.0% liked)

Dull Men's Club

925 readers
347 users here now

An unofficial chapter of the popular Dull Men's Club.

https://dullmensclub.com/

1. Relevant commentary on your own dull life. Posts should be about your own dull, lived experience. This is our most important rule. Direct questions, random thoughts, comment baiting, advice seeking, many uses of "discuss" rarely comply with this rule.

2. Original, Fresh, Meaningful Content.

3. Avoid repetitive topics.

4. This is not a search engine or advice forum.
Use a search engine, a tradesperson, Reddit, friends, a specialist Facebook group, apps, Wikipedia, an AI chat, a reverse image search etc. to answer simple questions, identify objects or get advice. We accept very few questions, and they must be over topics much more difficult than what is easily discoverable with a search. Also see rule 1, “comment baiting”.

5. Keep it dull. If it puts us to sleep, it’s on the right track. Examples of likely not dull: jokes, gross stuff (including toes), politics, religion, royalty, illness or injury, killing things for fun, or promotional content. Feel free to post these elsewhere.

6. Not hate speech, sexism, or bullying No sexism, hate speech, degrading or excessively foul language, or other harmful language. No othering or dehumanizing of anyone or negativity towards any gender identity.

7. Proofread before posting. Use good grammar and punctuation. Avoid useless phrases. Some examples: - starting a post with "So" - starting a post with pointless phrases, like "I hope this is allowed" or “this is my first post” Only share good quality, cropped images. Do not share screenshots of images; share the original image.

8. All polls must have an "Africa, by Toto" option. Why? Because we hear the drums echoing tonight.

founded 1 month ago
MODERATORS