Anubis rarely ever annoys me (I still prefer it over cloudflare's Mitm) but this specific visit feels almost vindictive. It used half my CPU cores at full blast for three straight minutes.
It seems to be effective since I can't really "bypass" it with extensions, so AI crawlers probably can't either, but damn there really should be an option to complete a manual captcha or email the administrators to complain.
As I'm typing this the challenge is still running xD
I wish AI scrapes didn't make the Internet unusable to the point of them using Cloudflare MITM or Anubis
My country's public TV stopped offering subtitle downloads for shows that can't be streamed online
(The transcript was always easily available with second-accurate timing by clicking the ㏄ button next to any subtitled program, whether or not it was available for streaming (usually indefinitely for old ČT production, 14 days for old movies and recent ČT production, never for new movies or shows). One person used this transcript of a documentary on nutria breeding verbatim (no edits except stage instructions and punctuation) to create a somewhat dadaist sci-fi musical featuring intellligent alien beings that happen to be called Nutria. And the frame-accurate, albeit Teletext-restricted (Czech+Slovak+German uppercase/lowercase alphabet only, 38x2, 1 subtitle/s, 7 colors) subtitles were also available by applying a simple Regex to the show page's URL. Now a unique subtitle URL is generated only when the server and JavaScript + WideVine player complete a handshake.)
A word of advice: download Arch wiki for offline use.
You can use Kiwix to have a full graphical wiki, or use things like arch-wiki-docs.
Why not use archive.org or similar to read the page?
For some reason that doesn't work for me when I am offline.
Honestly better than running into cloudfail every 5mins
Also this instance; can't browse it on Desktop with a Librewolf-alike policies.json. Can the sensibility be adjusted server-side? No problems on Archwiki & co.
I've had websites like Nix Hydra randomly give me a webpage full of gibberish which is also annoying and a lot moreso than the Anibus ones because you can't get past it, I thought they got hacked at first also
Difficulty 6 is a little high. The default is 4.
Think of it like tipping culture. Get mad at AI industry scrapers that make anubis necessary. Sam Altman is the reason you are enduring this. Take a lighter and...
Instructions unclear: tipped my servers, now all offline?
I suspect this is more about all the individual searches than mass scraping. We've had google et al scraping the entire web for a long time and nobody gave a fuck. AI makes it easy to launch a ton of web searches without putting much thought into it.
Search engines doing it is good because now you are indexed and will show up in searched and they won't do it as often as AIs.
AIs will take your stuff, DDOS you in the meantime and do it periodically - by different people too, they don't give back anything either
I wish it were doing protein folding work or something less wasteful.
I wonder if that could be a thing
FoldCoin
put crypto nonsense to work and maybe help fund research
My concern like everything open-source is a single person deciding to profit off of it.
Banano is also one. But this one is more of a memecoin.
Unfortunately yeah, people with exceptionally shit computers get caught in the cross-fire of these things
I've had Anubis get stuck for me before. Usually clears up if you refresh the page
The idea is that at individual scales the additional load is ignorable
So uh anyone anyone gonna tell them the idea was wrong? Three minutes is not ignorable.
The difficulty is typically dynamic based on current request load. At this difficulty typically means their server is getting hammered really hard, better this than the server just respond with a bad gateway error.
Wait, I'm not mining crypto trash for strangers whenever I see that annoying fox girl, am I?
crypto* as in cryptography, not *currency
Proof-of-work in approach, not towards the same ends. The goal is to prevent scraping, not monetization.
Trying to battle AI bots by making using AI even faster than reading actual documentation. Great job.
I've actually wanted to deploy this with some absurdly difficult challenge as a troll but I don't know what's worth putting behind a webpage with effectively a client side loading bar lol.
Find some relevant XKCD, and drop that on a 404 page
You did say you want to troll people
Your gpg private key
For everything
Maybe we should do a capture-able reward for anyone who can bypass Anubis lmao
Every time I watch Youtuße through Invidious and I get this crap, it gets stuck every time and goes nowhere.
Public invidious instances are more a proof of concept, its much more performant to run it yourself.
True.
Will set one up, if more need arises.
...but people keep sharing invidious links.
The last part of the url is still the same Video id from youtube. You can copy that in whichever you use.
The internet actually really needs an overhaul to how links are presented. So you can press a video link and opening in the compatible player you prefer.
Same issue exists on lemmy. A link will send you to the instance of the poster, we have special ! Links to bridge the gap but i can never remember how to use em.
Technically, the internet already has what you're looking for. It's just not really standardized for video media.
The beginning of the URL or the schema is already able to on most mainstream OS be controlled by a specific application.
There's nothing really stopping anyone from making it so there's a video:// schema, and then configuring a schema handler to handle it. on Debian it would be a single desktop file with a MimeType=x-scheme-handler/video line indicating that type of url should be opened with that desktop file. I had to configure it for vortex to get it to open mod links, I never knew how easy that was
This is every scraper for YouTube.
The only applications that I've ever seen reliably access YouTube are the ones that work by patching the YouTube app and then using what the app would do.
Applications like invidious or Grayjay almost always have a 15 to 30 second delay before any video.
My guess is that they, unlike the yt client, will wait for all the video to be streamed by the source instead of playing the first chunk
Home to all things "Mildly Infuriating" Not infuriating, not enraging. Mildly Infuriating. All posts should reflect that. Please post actually infuriating posts to !actually_infuriating@lemmy.world
I want my day mildly ruined, not completely ruined. Please remember to refrain from reposting old content. If you post a post from reddit it is good practice to include a link and credit the OP. I'm not about stealing content!
It's just good to get something in this website for casual viewing whilst refreshing original content is added overtime.
Rules:
1. Be Respectful
Refrain from using harmful language pertaining to a protected characteristic: e.g. race, gender, sexuality, disability or religion.
Refrain from being argumentative when responding or commenting to posts/replies. Personal attacks are not welcome here.
...
2. No Illegal Content
Content that violates the law. Any post/comment found to be in breach of common law will be removed and given to the authorities if required.
That means: -No promoting violence/threats against any individuals
-No CSA content or Revenge Porn
-No sharing private/personal information (Doxxing)
...
3. No Spam
Posting the same post, no matter the intent is against the rules.
-If you have posted content, please refrain from re-posting said content within this community.
-Do not spam posts with intent to harass, annoy, bully, advertise, scam or harm this community.
-No posting Scams/Advertisements/Phishing Links/IP Grabbers
-No Bots, Bots will be banned from the community.
...
4. No Porn/Explicit
Content
-Do not post explicit content. Lemmy.World is not the instance for NSFW content.
-Do not post Gore or Shock Content.
...
5. No Enciting Harassment,
Brigading, Doxxing or Witch Hunts
-Do not Brigade other Communities
-No calls to action against other communities/users within Lemmy or outside of Lemmy.
-No Witch Hunts against users/communities.
-No content that harasses members within or outside of the community.
...
6. NSFW should be behind NSFW tags.
-Content that is NSFW should be behind NSFW tags.
-Content that might be distressing should be kept behind NSFW tags.
...
7. Content should match the theme of this community.
-Content should be Mildly infuriating. If your post better fits !Actually_Infuriating put it there.
-The Community !actuallyinfuriating has been born so that's where you should post the big stuff.
...
8. Reposting of Reddit content is permitted, but attribution is not required in any way. No links to Reddit in post body
-If you would like to provide a source link, do so in the comments but not in the post body.
...
...
Also check out:
Partnered Communities:
Reach out to LillianVS for inclusion on the sidebar.
All communities included on the sidebar are to be made in compliance with the instance rules.