It’s unacceptable for a tool to sacrifice an iota of clarity, coherence, meaning, quality, etc. for the purpose of embedding hidden clues within the text to suggest its provenance. The idea that anything other than *my* needs should factor into the generation of text *for me* is patently offensive.
Sounds like someone wants to pass slop off as their own work product.
If they aren’t heavily editing, the text will be full of tells anyway. I don’t think anyone is passing slop off as their own for long. They either use it a little bit and edit it enough to obliterate any markers and tells (which is fine, imo), or they are going to be discovered.
Yeah that’s called transformation, which is fine. Means a human went over it.
There was a recent study that showed that people preferred AI writing to human writing.
The gist of the study is they took published short stories and prompted AI to write a comparable short story. They then presented the stories to a group of people, sometimes telling them which were AI written and which weren’t, but sometimes they intentionally lied and said the human-written story was AI written and vice versa.
People prefer AI written stories, and unsurprising, if they have a negative view of AI, they’ll rate stories they think are AI as worse, even when it’s not actually written by AI.
They also performed a test to see if people could differentiate between AI and human stories, and people could only tell ~45% to 50% of the time. Essentially a guess.
Now, being better at writing short stories doesn’t necessarily mean better at all forms of writing, but I think people who aren’t using AI have a mental snapshot of the capabilities of AI at some point in the past and assume AI hasn’t improved further since that mental snapshot was taken.
It’s very noticeable the majority of people who are anti ai have at this point years out of date views on what llms can do and what your avg joe thinks about them.
There’s plenty of reasons to legitly hate ai. But its amazing how frequently I see someone hate on so for something that got solved a year ago. Be cause their only interaction with it is the cheapest form of ai, and typically a very out of date model on top of it.
It’s like people judging a modern car as if it’s a 1920 rust bucket.
That isn’t really a rebuttal of my statement. It’s not even particularly salient. Sure your average person might like AI writing and not be able to tell it from human works — just like they can’t tell the authenticity of a photograph of Aunt Margaret from a photograph of Trump meeting an alien from Rigel IV. But there are plenty of people who can, and so anyone trying to pass slop off as their original work will be discovered. It’s just a matter of time.
That being said, I use AI quite a bit in writing stories — though it’s more like solo roleplaying. I don’t think it’s particularly good at all, but it does while away the hours sometimes, as long as your expectations are low. I can’t see anyone who enjoys reading being enamored with AI. My wife reads over 300 books per year, and she spots it pretty easily.
Do you have any scientific evidence to support this claim?
What model are you using?
Bold claim from someone who spends hours writing AI stories for themself. Then again, I guess I am assuming you consider yourself a person who enjoys reading.
That’s over 5 books a week. I find if difficult to believe she’d notice if you slipped a book she read in January book into the list for this month, let alone an AI generated story. Still, that’s an impressive amount of books. My wife reads about 100 a year, but they’re almost all in her favorite genre, crime drama, and I am completely certain I could get a decent AI model to output a full length book in that genre and she wouldn’t notice. I’m not sure quantity of books read in a time frame really tells us much, either way, about the ability to detect AI generated writing.
Yes, thank you — you provided it. According to the paper cited, people with more familiarity with AI are much better at detecting its output than an average person. But I already knew that empirically.
Mostly a fine tuned GLM 5.2 purpose-built for writing. Not that I haven’t also used frontier models but they suck at uncensored roleplay with violence and conflict and evil bad guys and such. GLM still fails with errors of attribution and state.
shrug It’s pretty bad but it’s better than no roleplaying at all. Plus the interface lets me edit whatever I want so I can fix any outright errors.
That is interesting. The only time I really tried to use AI to write was a noir mystery. Dear god did it suck. It couldn’t follow instructions at all. Show don’t tell is probably more on display in noir than other genres and it couldn’t do it without constant correction. It kept falling back to its standard voice of third person omniscient instead of unreliable narrator.
There were parts that were written well, but a lot that was just grating and gratuitous. I had to edit like 85% of the output. I had to keep arguing with ChatGPT to write differently. And every once in a while it would swallow its own writing because it tripped its own content warnings. I suppose that’s neither here nor there on the writing quality, but we are far from having an AI write a novel without being full of tells.
AI isn’t there yet in terms of a quality or undetectability. And it doesn’t look to me like it’s going to get there any time soon.
Yes, people in general prefer bland and easy to follow stories. I would bet the majority of participants in the study don’t normally read short stories since moat people don’t read for enjoyment. Blockbusters and the vast majority of popular movies follow predictable story beats in a clear and accessible way. Same is true for books.
AI is the McDonald’s of writing and that isn’t a point in its favor unless all we care about is mass consumption of regurgitated and reworded stories humans wrote originally.
When confronted with data that people preferred AI writing to human writing, your reaction is to make something up about the participants? Wild.
Even if I accept that people just want to read garbage and they wouldn’t know “good” writing if they saw it, so what? How does that affect anything we’re discussing?
There is nothing wrong with their guess. The paper you linked says nearly the same thing:
Being easier to read and understand is a sign of good writing, and being easy to follow and read does not mean something is “bland”.
The fact of the matter is that we have evidence that AI can write in such a way that the writing is judged better than human writing, as judged by humans. Dismissing the study by “betting” that the study participants didn’t like to read is unscientific nonsense, in no way comparable to what you quoted. That’s a person being confronted with facts that contradict their current beliefs and rejecting facts to maintain those beliefs.
Personally, I don’t even understand the point in refusing to believe that AI can be better at humans at some tasks. What is gained by maintaining that belief?
A very valuable comment compared to the author of OP’s article who simply seems entitled to this cloud service?
I’m sorry, was this reply meant for me? I don’t see how it fits as a response to my comment.
Yes. I was quoting some insight from the piece you linked, so it seemed appropriate to reply to your comment here.
I don’t mean to be dense, but can you elaborate on what point you were trying to make in context to my comment? I still don’t see what it has to do with what I said.