516
BBC will block ChatGPT AI from scraping its content
(deadline.com)
This is a most excellent place for technology news and articles.
You might not be able to stop an AI directly because of the reasons you listed. However, OpenAI is probably at least competent enough to not send the response directly to the AI but instead have a separate (non-AI) mechanism that simply doesn't let the AI access the response of websites with a certain line in the robots.txt.