491

Fiction written by artificial intelligence is easy to detect because it struggles with complex story structure and tends to moralize in clunky ways, according to a preprint study from researchers at University of Maryland, College Park and Google DeepMind. They found that AI fiction has tells that go beyond stereotypical overuse of em-dashes and other obvious AI tropes and have more to do with the formulaic nature of the text itself.

“AI stories over-explain themes and favor tidy, single-track plots while human stories frame protagonists’ choices as more morally ambiguous and have increased temporal complexity,” the study, which looked at more than 50,000 AI-generated short stories, found. “Claude produces notably flat event escalation, GPT over-indexes on dream sequences, and Gemini defaults to external character description. We find that AI-generated stories cluster in a shared region of narrative space, while human-authored stories exhibit greater diversity. More broadly, these results suggest that differences in underlying narrative construction, not just writing style, can be used to separate human-written original works from AI-generated fiction.”

Basically, AI-generated fiction sucks and at the moment is easy to detect. The typical method of detection involves looking for stylistic markers such as an abundance of em-dashes, the overuse of the word “delve,” or an obsession with goblins, but this project tried something different. “The idea for this project came because we are hoping to eventually move past plain text detection, into some sort of space where we can separate human ideas from AI-generated ideas,” Jenna Russell, a University of Maryland researcher and one of the study’s authors, told 404 Media. Russell is also an intern at the AI-detection company Pangram.

top 50 comments
sorted by: hot top controversial new old
[-] november@piefed.blahaj.zone 17 points 1 day ago

No kidding. Anyone else visit the SCP wiki? It's so blindingly obvious which new skips are LLM-generated, but the "authors" always play dumb like "Huh??? What makes you say that????" when their skips are like "SCP-12345 is multiversal, ethereal, and ruminant. We are not containing it—it is containing us."

[-] melsaskca@lemmy.ca 9 points 1 day ago

I'd expect AI fiction to be equivalent to the 100 monkeys in a room with 100 typewriters. Eventually they'll push out a good one but mostly it'll be just crap.

[-] ragas@lemmy.ml 2 points 12 hours ago

Since LLMs try to find the most lilely word combinations, I'd say it is actually impossible for an LLM like we have them now, to write a surprising or exiting book.

[-] melsaskca@lemmy.ca 1 points 11 hours ago

That's what the monkeys thought too. /s 😊

[-] FellowEnt@sh.itjust.works 21 points 2 days ago

I was recently talking to an independent bookshop owner, looking at some of the submissions for self-published books. It was depressing as fuck. An absolute slop fest. The 'illustrated' childrens books were by far the worst offenders.

[-] Dpek@lemmy.zip 2 points 1 day ago

Now im wondering what brand of slop its put out for the illustrations

[-] FellowEnt@sh.itjust.works 5 points 1 day ago

There was a short book about a teddy bear. The art style started off as cute but obvious slop pencil lines with color shading. By the end of the book it had fully morphed into nightmarish photorealism. Absolutely demented.

[-] MartianRecon@lemmus.org 25 points 2 days ago

LMMs are just mediocrity machines.

You input one great book, and 25 dogshit fanfictions, you're not going to output a great book.

It's like teaching someone how to cook Chateaubriand, but also 19 recipes for hot dogs, and then expecting them to make braised lamb or some shit.

[-] Noja@sopuli.xyz 17 points 2 days ago

You are wrong, even a LLM fed with 26 great books couldn't write a good one.

[-] binux@sh.itjust.works 3 points 1 day ago

”If you give a robot one good chemistry textbook and 25 bad chemistry worksheets, it isn’t going to get a chemistry PhD”

”You are wrong, even a robot given 26 good chemistry textbooks couldn’t get a chemistry PhD”

”Uhhh yeah but that doesn’t contradict the point I’m making”

????????

[-] MartianRecon@lemmus.org 10 points 2 days ago

Oh, I fully fucking agree.

I'm just putting this in 'crayon eater' terms for them to try and understand.

[-] umbraroze@slrpnk.net 23 points 2 days ago

I remember the stuff they added to Duolingo after the leadership went "AI first".

Duolingo has these story exercises. Old stories were all kind of fun and distinctive, and the characters are fun and memorable. Then they got the bright idea to AI generate more stories.

"Oh, don't worry, the new content will all be reviewed by humans", they said.

Were they?

The new stories were... I don't even remember any more. Best I can describe them is "there's stuff and it happens and the characters are just kinda there". It went in one ear, out of the other. I fucking can't. I don't think I was learning stuff from that.

And these were tiny stories, like couple of hundred words tops. Anyone uses LLMs to write novels is out of their rocker.

[-] Lumidaub@feddit.org 12 points 2 days ago

there's stuff and it happens and the characters are just kinda there

You're welcome to ignore this, but I feel I have to point out, not to you, but the universe in general (and just coincidentally as a reply to your comment), how well this describes almost everything about the most recent two episodes of a beloved TV series featuring a blue box that travels in time and space (which I like the usual amount). I'm going to go cry now. 🟦

load more comments (1 replies)
load more comments (1 replies)

I mean yeah they mostly learned from fanfic authors.

[-] the_riviera_kid@lemmy.world 54 points 2 days ago

50 shades of grey was also stupid and bad and it very much was not written by AI.

[-] Dpek@lemmy.zip 1 points 1 day ago

50 shades of gray was very gray tho

[-] the_riviera_kid@lemmy.world 2 points 11 hours ago

50 different shades of it in fact.

[-] hansolo@lemmy.today 50 points 2 days ago

I learned recently that it was actually Twilight fanfiction to start, and the author had to tweak the world to make the vampires rich guys.

Which I guess explains it a bit more.

[-] tonytins@pawb.social 25 points 2 days ago

To be fair, it was heavily implied that the Cullens were rich. At least in the films.

[-] AmyAye@nord.pub 11 points 2 days ago* (last edited 2 days ago)

If you are a Vampire, especially one of the type where you "mostly act nornal and sometimes suck blood" and not some bat man horror monsyer, you would have a hard time NOT being rich really.

You could potentially work like 5 jobs, you have very few expense needs like food or even proper shelter if you want to save up. Even just a basic investment of any kind would grow enormously over a hundred years.

[-] Lucidlethargy@sh.itjust.works 8 points 2 days ago

This just makes me realize that the old people were going to high school in twilight...

I googled it. Edward is over 100.

What the fuck? Just... What the fuck? Bella, was fucking 17.

Jesus Christ, no wonder the presidents a pedophile and nobody cares.

[-] AmyAye@nord.pub 1 points 8 hours ago

This point came up a lot in Buffy communities as well.

Heck maybe even on the show.

Buffy is in High School, start of the show she is like, 16 or 17.

Angel is like, 250 years old or something.

[-] athatet@lemmy.zip 7 points 2 days ago

The book explains it by saying every few decades they go back to school to relearn what all has changed, so that part at least kind of makes sense. The falling in love with high school students is hella gross tho.

[-] AmyAye@nord.pub 2 points 8 hours ago

I have an "unwritten story" not about vampires but with an immortal character that sort of touches on this.

Like at one point she and another character become involved. By the sequel, which is 20 years later, they kind of had a falling out, because she can't deal with the idea of basically never aging while her partner gets old and dies. It also means she refuses to get involved with anyone else.

[-] nickiwest@lemmy.world 6 points 2 days ago

I stopped being interested in high-schoolers as friends or romantic interests by the time I graduated from university. Our frames of reference were too different for meaningful connection.

Somewhere around 30, I became actively disgusted by the idea of someone my age socializing with teenagers outside of a familial, educational, or mentoring role. (That one guy who graduated from high school 12 years ago and still gets invited to students' parties because he is willing to bring beer? He's gross. And so is the 35-year-old teacher who ran off with one of his students the day after she graduated.)

I'm in my mid-40s now and my feelings haven't changed. I don't expect that another 60 years of life experience is going to bring me around to the other side.

And that is why I will never understand why Arwen Undómiel would give up her immortality for a man nearly 2,700 years her junior. Even if that man was the legendary Aragorn, son of Arathorn, the most heroic hero I've encountered in my literary life.

Thank you for coming to my TED Talk.

[-] Ilixtze@lemmy.ml 8 points 2 days ago

50 shades of grey and fanfics like my immortal are fun to read because a person was weird enough to write them. Llm slop is just spam.

load more comments (1 replies)
[-] trem 44 points 2 days ago

Claude produces notably flat event escalation, GPT over-indexes on dream sequences, and Gemini defaults to external character description.

Which are all ways of creating more text without saying anything. Repetition is another classic.

I feel like that's a problem with all low-effort, AI-generated texts (which is the vast majority of them): You give it a prompt with maybe ten pieces of information and expect it to generate a text that's a hundred times as long, while also not straying too far from the prompt.

Of course, it's going to take every opportunity to not say anything that would advance the plot. Because advancing the plot means either using up the little input you gave it, or to invent new information which might contradict the prompt...

load more comments (1 replies)
[-] muusemuuse@sh.itjust.works 3 points 1 day ago

Well yea, they are basically pocketFM ads on YouTube. Just awful.

[-] BloodMuffin@lemmy.ca 37 points 2 days ago

the overuse of the word "delve" is hilarious

load more comments (5 replies)
[-] queermunist@lemmy.ml 26 points 2 days ago* (last edited 2 days ago)

Other tells I've noticed: lots of purple prose, sentence fragments, and the good ol "not X---Y" framing. Another tell is jarring tone shifts from chapter to chapter or even scene to scene i.e. a character might come across as sympathetic in one part of the story and an absolute psychopath in another for no reason.

It's a problem in fanfic right now, but I think this'll pass when prices innevitably go up. It's not like fanfic writers are really making that much from donations.

load more comments (1 replies)
[-] nullspace@lemmy.world 7 points 2 days ago

AI stories give me whiplash with how borderline personality disorder the characters seem after any significant length.

load more comments
view more: next ›
this post was submitted on 11 Jul 2026
491 points (100.0% liked)

Fuck AI

7614 readers
1358 users here now

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.

founded 2 years ago
MODERATORS