894
Study of 8k Posts Suggests 40+% of Facebook Posts are AI-Generated
(originality.ai)
This is a most excellent place for technology news and articles.
In that case, how/why did they only choose 8000 posts over 6 years? Facebook probably gets more than 8000 new posts per second.
I was wondering how far I'd have to scroll before getting to someone who doesn't understand statistics complaining about the sample size...
There's likely been trillions of posts on Facebook during that time frame. Is a sample size of 8000 really sufficient for a corpus that large?
Have you ever heard of "margin of error"?
Learn statistics, it's actually super informative.
Every study uses sampling. They don't have the resources to check everything. I have to imagine it took a lot of work to verify conclusively whether something was or was not generated. It's a much larger sample size than a lot of studies.
The study is by a company that creates software to detect AI content, so it's literally their whole job
(it also means there's a conflict of interest, since they want to show how much content their detector can detect)
It's an extremely small proportion of the total number of Facebook posts though. Nowhere near enough for statistical significance.