661
This is Hostile to Business
(lemmy.blahaj.zone)
A place to share screenshots of Microblog posts, whether from Mastodon, tumblr, ~~Twitter~~ X, KBin, Threads or elsewhere.
Created as an evolution of White People Twitter and other tweet-capture subreddits.
Rules:
Related communities:
You answered your own question. The search engine indexes your page to send traffic to you. The AI bot indexes your page to plagiarize your content.
Anecdotally, AI also routinely ignores sites' robots.txt and spoof their agents to try to hide what they're doing. A lot of site owners are complaining about the costs of delivering content to web scrapers. Where search indexes might hit a site every day, some AI bots are running every hour and just wasting their bandwidth.