Frontier AI models overuse language linked to reading difficulty, study finds
A 14-model comparison tracks difficult sentence patterns, not readers’ comprehension. A related experiment shows how pressure for shorter answers can change grammar.
Loading page…
A 14-model comparison tracks difficult sentence patterns, not readers’ comprehension. A related experiment shows how pressure for shorter answers can change grammar.
Listen to this story
An arXiv study dated October 21, 2026, finds that nine frontier and near-frontier models use several sentence patterns associated with harder-to-process language more often than human comparison texts. The researchers’ experiment suggests that rewarding shorter answers can shift grammatical choices, but it does not show that brevity training caused the commercial models’ patterns or that readers understand their outputs less well. For model builders, the findings point to a possible trade-off: optimizing for compactness may affect readability in ways that simple length metrics miss.
The analysis covered 14 models, 120 conversations, 45 coding sessions and 980 essays, measuring six linguistic features rather than testing reader comprehension.
All nine frontier and near-frontier models used more unusual word combinations and more inanimate subjects paired with animate verbs than human comparison texts.
Llama and Olmo Base were closest to human writing on the measured features; within Olmo, deviations rose from Base to Instruct to Think.
Shorter AI answers are not necessarily simpler ones. A new study finds that leading language models favor sentence patterns associated with reading difficulty. A related experiment offers a possible explanation: rewarding brevity can change grammar, even without instructions to write densely. The findings concern linguistic patterns, rather than a direct test of readers’ comprehension.
The paper, posted to arXiv on October 21, 2026, is by Thomas Hikaru Clark, Matias B. Martin and Kyle Mahowald. The NYU and University of Texas at Austin researchers examined 14 models across 120 conversations, 45 coding sessions and 980 essays. Human comparisons included subtitles, StackExchange discussions and student essays.
The researchers tracked six features linked to the effort of processing language:
All nine frontier and near-frontier models used more unusual word combinations and more inanimate subjects with animate verbs than human comparison texts. Most also showed more long grammatical gaps, stacked nouns and dropped connectors in conversation.
Translating outputs into Japanese and back into English largely preserved meaning while reducing most measured difficult constructions. The authors interpret that as evidence of stylistic preference, rather than necessity.
Llama and the Olmo base model were closest to human writing on the measured features. Within Olmo, deviations increased from Base to Instruct to Think. The Decoder highlights that progression as a clue that training after the initial model-building stage may shape these tendencies.
Opus 5.5 used fewer difficult constructions in 19 comparisons; eight had non-overlapping 95% confidence intervals.
The authors hypothesize that training for math, code and reasoning favors information density over communication. To test one part of that explanation, they fine-tuned Qwen2.5-1.5B-Instruct using reinforcement learning to convert structured event descriptions into sentences.
Stronger length penalties generally increased preference for shorter wording, including unseen constructions involving optional “that.” Transfer to more distant grammatical patterns was much weaker.
The authors call this a proof of concept: the model was never instructed to use compressed language. It shows that a training penalty can alter grammar, not that the same penalty caused commercial models’ observed patterns.
Loading discussion...
Join the conversation
Explain when extra words help—or just get in the way.
Be the first to share a perspective or an experience.
Reader comments
Newest comments first. Replies stay oldest first.