102
Soooo what's the other 20% if not crawlers?
I couldn't click the cookie policy garbage because the AI chat bot obscured the buttons on that page.
Talk about AI slop
Are they sure that the Meta traffic is AI bots? A lot of people share links in posts on Meta products, which scrape the links to generate a preview.
Aren't those requests made from client devices?
They are for anything that's E2E encrypted such as Messenger and WhatsApp, so that the link isn't revealed to Meta servers.
As far as I know, for things like posts on Facebook, the server does the scraping. This is especially the case in the web version, since client-side scraping of arbitrary sites would require those sites to have an open CORS policy, which comes with security risks.
There's a Sharing Debugger tool on the Facebook developer site that lets you force rescrape a site.
It would not surprise me to see that the traffic traced back to "scrapers". A user's perceived relevance often ties to the recency of the dataset.
this post was submitted on 22 Aug 2025
102 points (100.0% liked)
Technology
74289 readers
4087 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS