270
submitted 1 year ago* (last edited 1 year ago) by Nerd02@lemmy.basedcount.com to c/fediverse@lemmy.world

EDIT 3: All good now, the DNS has done its thing and defed.xyz is fully operational! Once again, thank you all for having checked out my tool, it means a lot to me.

Deploy problems, read more

EDIT 2: I've managed to fix it as well as add some optimization measures. Now it shouldn't ramp up bandwith nearly as fast. The DNS records are still propagating for https://defed.xyz so that might not work, in the meantime you can use the free Netlify domain of https://sunny-quokka-c7bc18.netlify.app

EDIT 1: You guys played too much with my site and ended up consuming this entire month's 100GB limit of free quota, so the site is currently blocked.

This is probably my most succesful project ever, thank you all for checking it out. It will take me some time to find another suitable host and move the project there.

ORIGINAL POST: I couldn't find any tools to check this, so I built one myself.

This is a little site I built: the Defederation Investigator defed.xyz. With it, you can get a comprehensive view of which instances have blocked yours, as well as which ones you are federated with.

The tool is open source and available on GitHub. Hopefully someone will find it useful, enjoy.

top 50 comments
sorted by: hot top controversial new old
[-] delendum@lemdit.com 16 points 1 year ago

Awesome project and the tool looks great - nice work!

There was an existing tool which was similar: https://federation-checker.vercel.app/

Yours is definitely nicer.

[-] Nerd02@lemmy.basedcount.com 10 points 1 year ago

Oh didn't know about that. It doesn't look too accurate though. My instance was defederated by some guy and it isn't showing. Anyway thank you, glad you like it!

[-] iso@lemy.lol 4 points 1 year ago

Does defed.xyz checking other softwares like Akkoma? For my instance, defed.xyz shows only dubvee.org is defederated, which is correct.

But in the other hand, federation-checker shows only matrix.rocks defederated, which is a Akkoma instance. I'm not sure is it correct since IDK where is Akkoma's defederated list but both sites showing different sites.

[-] Nerd02@lemmy.basedcount.com 8 points 1 year ago

To be fair this is the first time I hear about Akkoma, I wasn't even aware of its existence.

Right now the Investigator queries all instances in the awesome-lemmy-instancecs repo, which means it only queries instances running the Lemmy software. I didn't really consider this, but evidently this also cuts off Kbin, Mastodon and so on.

To expand on this I would need a list of all fediverse / threadiverse instances, or at least the onest that federate with Lemmy. I don't know if such a list exists out there.

[-] iso@lemy.lol 5 points 1 year ago

Alright I don't really care other than Lemmy anyways. Maybe kbin. IDK your tool is the best among the other ones, so well done ๐Ÿ™

[-] Nerd02@lemmy.basedcount.com 5 points 1 year ago

Thanks a lot! I'll see if I can make any improvements on this front, but I can't make any promises.

[-] can@sh.itjust.works 2 points 1 year ago

It also shows pawb.social defederated from sh.itjust.works but I swear I've seen comments by them.

[-] Nerd02@lemmy.basedcount.com 2 points 1 year ago

My site is back online (albeit under a different domain for now, see edited post) and indeed it says you guys and pawb.social are federated.

[-] can@sh.itjust.works 2 points 1 year ago

Nice! Thanks for the update.

[-] Nerd02@lemmy.basedcount.com 2 points 1 year ago

Might be old stuff dating before the defederation? Idk, I don't think I can get my hands on any historical log. I just know that it happened, can't know when though.

[-] can@sh.itjust.works 2 points 1 year ago* (last edited 1 year ago)

I was taking about the other one actually. Didn't get a chance to try yours.

[-] Nerd02@lemmy.basedcount.com 2 points 1 year ago

Oh my bad then. Hopefully I'll be able to fix mine soon enough.

[-] TheGreenGolem@lemm.ee 14 points 1 year ago* (last edited 1 year ago)

Umm, I think you used up your quota at Vercel.

402: DEPLOYMENT_DISABLED

This deployment has been disabled, as the fair use policy guidelines have been exceeded.

[-] Nerd02@lemmy.basedcount.com 10 points 1 year ago

Yeah I just saw it. Good God, apparently people really enjoyed playing with it.

[-] Amaltheamannen@lemmy.ml 8 points 1 year ago

Sounds like you need to use some caching

[-] Nerd02@lemmy.basedcount.com 2 points 1 year ago

That might be a solution, but I think I might get there just by optimizing what's already there. I started this yesterday and it was to be a one afternoon project, mostly for personal use. I never built anything this quickly and some aspects where definitely rushed.

More importantly, I wasn't aware Vercel had bandwith limits. I guess I've fucked around and found out.

[-] TheGreenGolem@lemm.ee 4 points 1 year ago

That's what she said.

[-] Blizzard@lemmy.zip 7 points 1 year ago
[-] Disgustoid@startrek.website 5 points 1 year ago

This tool is great! Thanks for creating it and making it public.

Also, is this the first Lemmy Hug of Death? If so, congrats, I think?

[-] Nerd02@lemmy.basedcount.com 4 points 1 year ago

Not sure if it's the first but it's definitely a first for me. In retrospect I could have written it way better, the logic was a bit rushed, but it should be fixed now.

I love the amount of support I've been getting from this and other threads, thank you for using my site.

[-] Untitled_Pribor@kbin.social 4 points 1 year ago
[-] Nerd02@lemmy.basedcount.com 3 points 1 year ago

Yeah sorry about that, I couldn't find a list of instances that also included kbin ones. The best I could find was the awesome-lemmy-instances repo, which as the name suggests is strictly Lemmy.

If you have a list that includes kbin I'll be happy to add support for it.

[-] Untitled_Pribor@kbin.social 7 points 1 year ago* (last edited 1 year ago)

There's this one, but it only includes kbin instances

[-] Nerd02@lemmy.basedcount.com 6 points 1 year ago

Update: apparently kbin doesn't support this kind of operation. In other words there's no way of knowing what instances a kbin instance is federated with. I'm sorry but this really isn't my fault. I'll see if I can add it later on, once the kbin devs finish working on this feature.

[-] density@kbin.social 2 points 1 year ago

There is an issue open in the kbin repo.

[-] Nerd02@lemmy.basedcount.com 6 points 1 year ago* (last edited 1 year ago)

Thank you. Actually that list is a bit hard to interact with, but I've found this API and it works great. I'll be adding kbin support in the next couple days.

[-] Fizz@lemmy.nz 4 points 1 year ago

Cool I need to bookmark this.

[-] Nerd02@lemmy.basedcount.com 4 points 1 year ago

The greatest of honours, thank you.

[-] csolisr@communities.azkware.net 3 points 1 year ago

Today I learned that one of the biggest Spanish instances, Mujico, apparently doesn't federate with anyone else. Ah well

[-] Ward@lemmy.nz 2 points 1 year ago

Dracula ๐Ÿฆนโ€โ™€๏ธ

[-] Oha@lemmy.ohaa.xyz 2 points 1 year ago

Awesome stuff. Thanks!

[-] xtremeownage@lemmyonline.com 2 points 1 year ago

Interesting. Guess, dmz.social defedered my instance, for... unknown reasons.

Never even knew that instance existed.

[-] xtremeownage@lemmyonline.com 6 points 1 year ago

@daan@lemmy.vanoverloop.xyz

I am disappointed in you!

LemmyOnline gave your instance a guarantee, and then you defederated it!

[-] Nerd02@lemmy.basedcount.com 9 points 1 year ago

Lmao. This is the kind of drama I built this for, let's have a look at everyone's dirty laundry :)

[-] xtremeownage@lemmyonline.com 3 points 1 year ago

Honestly, kind of surprised my instance was only defederated twice. Not, sure what I expected, but.. /shrugs.

[-] hellequin67@feddit.uk 2 points 1 year ago

Great app.

Might be nice to also have a section for instances that the searched instance has defederated from.

I know this can be seen elsewhere but would be nice to have all the information in one place.

[-] Nerd02@lemmy.basedcount.com 4 points 1 year ago

Sure, I could do that. The only reason why I didn't was because that info is just one click away, it's really easy to see that from an instance's web page (while it isn't so easy to see the rest of the data I am displaying).

[-] Cryxtalix@programming.dev 2 points 1 year ago

What does returning errors mean? I had a main account that I tried migrating away from lemmy.world, only to have it return errors from lemmy.world. I can't see two thirds of the comments I can from this programming.dev account.

[-] Nerd02@lemmy.basedcount.com 3 points 1 year ago

For some reason when I query programming.dev, as well as a couple other instances from my Vercel deployement I get 403s "Forbidden" errors. Not really sure why, it works when I run it from localhost? Maybe them or their provider have somehow blocked request from Vercel because they are afraid of bots? It's anyone's guess really.

This site is built on top of the lemmy-js-client, which is maintained by the Lemmy developers, unfortunately there isn't any API documentation to look at, so for those times when the JS client doesn't work it's very hard for me to debug it and troubleshoot it.

BTW you can look at these errors yourself in your browser's "network" tab, all errors return 500s. In the request body you can see the queried URL, in the response you can see the error message. Sometimes it's "Forbidden", some other time it's a timeout (possibly due to the instance being offline or severely overloaded).

this post was submitted on 21 Aug 2023
270 points (100.0% liked)

Fediverse

28408 readers
948 users here now

A community to talk about the Fediverse and all it's related services using ActivityPub (Mastodon, Lemmy, KBin, etc).

If you wanted to get help with moderating your own community then head over to !moderators@lemmy.world!

Rules

Learn more at these websites: Join The Fediverse Wiki, Fediverse.info, Wikipedia Page, The Federation Info (Stats), FediDB (Stats), Sub Rehab (Reddit Migration), Search Lemmy

founded 1 year ago
MODERATORS