8
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 14 Jun 2026
8 points (100.0% liked)
🖧🗫🤝 Collaboration tools 🛠⚒🚧 (git, forges, bug trackers 🔎🪲, gitea, gitlab)
132 readers
9 users here now
This is going to generally be about git forges like gitea, but it’s open to discussion about any collaboration assisting tools and platforms.
Related communities: !librecomms@scribe.disroot.org
founded 5 years ago
MODERATORS
Any content that is not hidden (private) is effectively public since crawlers will eventually find it, even if it's not in the built-in search
I’ve often wondered about the reach of crawlers. Don’t crawlers need to be seeded with links? Don’t they rely on links that are published on crawled pages? If there is no navigable path to the repo, how would a crawler find it?
Of course if a friend publishes the link, all bets are off. And I would accept that.
While that is the main way how pages are discovered, some scrapers also just try random URLs, or known words from leaks