4

Apologies if crossposting is against the rules; I'm not entirely sure where the lines are drawn here yet.

I posted this in lemmy.fosscad (fosscad@lemmy?), but realize that may not be the most active venue.

I grabbed archives of fosscad and took a look at the contents of the zst's. I think I could probably rebuild the contents of the subreddit in some manner or another; the question is scale and hosting. How would we make the posts easily searchable, where would they live, what endpoint can we upload hundreds of thousands of comments into in a reasonable time frame... all that fun stuff.

The archives don't contain pictures, but contain links to the pictures and the ones I've checked are currently still live (meaning the pics are still hosted on reddit). Dunno how long that will remain the case.

I have no idea what the size of the archives would be with pics downloaded; gigs, a TB, no clue. I'm posting this to gauge public interest and I haven't done much preliminary work (oh, these are json. Yep, dictionaries work. Wingo.)

Is there any interest in making this more publicly available? I've run into an issue with a particular build and I'll be diving through the archives to fix it for my self. It seems like a shame that all this information would be inaccessible to everyone who isn't able or interested in trawling through their own local archives.

I'm not a programmer by trade, but work in an adjacent space. I can plink along on this if other people are interested (and if anyone is interested enough to help pitch in, even better).

you are viewing a single comment's thread
view the rest of the comments
[-] gsgmfg@fosscad.io 0 points 2 months ago

I'd be interested in figuring out a way to either re-upload them onto Lemmy or similar.

We should definitely download the pics while we still can.

I have a bridge I wrote that pulls r/gundeals to !bazaar@fosscad.io - could do something similar with a bot to post to to a community.

[-] hogleg@forum.guncadindex.com 1 points 1 month ago

Oh, that's awesome. If you've got a bot that can already parse and push to fosscad.io, we should definitely be able to tweak that. I'm not active on discord (any social media really), but I imagine that's the place to organize an effort like this. If there is an alternative that others prefer (I've heard about matrix and element), I'm open to suggestion.

I've been fighting the flu the last couple of days, but on the upswing now. Dunno how much I'll be able to dig in today, but I'll get a github set up; I can dump the zst's there and some psuedocode and notes. If I can see what your bot is ingesting, I can try to match output from the zst's to it.

I think there will be a bit of work marrying comments to submissions; they're split up into two separate archives. Since the pictures are time sensitive (potentially), maybe the move is trying to focus on looping through the submissions and grabbing the pics from their urls, then rebuilding after the fact.

I've got plenty of local storage for pics or if we can dump straight to lemmy, that would be great. I'm completely ignorant to this platform as far as rate-limiting, storage, any of that fun stuff. I don't know how big a whole subreddit will end up being, but I imagine it's not inconsequential.

this post was submitted on 07 Oct 2025
4 points (100.0% liked)

General Discussion

423 readers
50 users here now

Discuss anything GunCAD related. If you need help, see /c/help. If you think you're discussing a thing a lot of the time, consider making your own separate community.

Abide by the global rules or be smitten.

Shitty stock image may be changed at moderator discretion.

founded 2 months ago
MODERATORS