All stories
Analysis /

AI Tells: the words that left

On GitHub, the vocabulary everyone blames on language models is still climbing. I ran the same word list over 25,000 arXiv abstracts expecting the same line. Science got there a year earlier, peaked in early 2025, and has been handing the words back ever since.

By Joseph Kato LanguageAIScience

In August I pointed a prose linter at GitHub and found the vocabulary of language models spreading through issues and pull requests. One line in that piece has nagged at me since: “Nobody delves into a stack trace.” The celebrity tell was missing, and I blamed the venue.

So here is the venue where people do delve. The instrument is the same one — the 176 flagged words from vale-ai-tells, a style package for Vale — run over 25,215 arXiv abstracts from 2018 to 2026, across the same 8 fields as the hedging piece. Each year is sampled at four points, January, April, July, and October, which turned out to matter.

I expected a steeper version of the GitHub chart. That is not what came back.

Up, and then down

Flagged vocabulary in arXiv abstracts

vale-ai-tells matches per 1,000 words, sampled each quarter, all eight fields.

Show the data
QuarterarXiv abstracts
Jan 222.55
Apr 222.74
Jul 222.61
Oct 222.6
Jan 232.56
Apr 232.49
Jul 233.35
Oct 233.59
Jan 243.49
Apr 243.74
Jul 243.64
Oct 243.64
Jan 254.4
Apr 254.28
Jul 254.36
Oct 253.71
Jan 263.38
Apr 262.96
Jul 262.76
Oct 262.12

Source: arXiv abstracts; scored in scripts/fetch-arxiv-ai-tells.mjs

For five years the rate sat near 2.35 per thousand words. It was still there in January and April of 2023 (2.56, 2.49), months after ChatGPT launched. Then July 2023 came in at 3.35, and it kept going: 3.63 across 2024, and 4.4 in January 2025, the top of the series. At the peak, 43% of abstracts carried at least one flagged word, against 27% before.

Then it turned. 3.71 in October 2025, 3.38 in January, 2.96 in April, 2.76 in July, 2.12 last month. Five quarters down in a row, and the latest is under where the series began.

Science moved first; GitHub moved more

The same word list, two corpora

Flagged-word rate by year, each indexed to its own 2020 to 2022 average (100).

  • arXiv abstracts
  • GitHub issues
Show the data
YeararXiv abstractsGitHub issues
20209897
20219695
2022107109
2023122101
2024147152
2025169244
2026113—

Source: arXiv abstracts and GH Archive; GitHub series from the first piece

The raw rates are not comparable. Abstracts run about 7 times GitHub’s baseline, because robust, scalable, and state-of-the-art were scientific vocabulary long before they were anyone’s tell. So this chart sets each corpus against its own past.

In 2023 GitHub had not moved at all (101), and arXiv was already at 122. That fits what each tool did. A researcher could paste a draft abstract into a chatbot the day it launched. An issue tracker had to wait for assistants that live in the editor.

But GitHub went further once it started: 244 by 2025, against 169 for arXiv at its peak. My GitHub series stops there, so I can’t say whether it has turned too. On arXiv, 2026 is back to 113.

Delve, at last

Delve

Uses of delve, delves, delving, or delved per million words of abstract, by year.

Show the data
Yeardelve, delves, delving, delved
20180
20192
20202
20212
20222
202319
202437
202510
202611

Source: arXiv abstracts; scored in scripts/fetch-arxiv-ai-tells.mjs

Here it is. In the five years before, the word turns up 4 times in 13,591 abstracts. Then 9 in 2023 and 18 in 2024.

And then 5, and 6. The most famous tell in the language had about two years. Its reputation has lasted longer than the word did.

Which words, and what’s left of them

What rose

Flagged words by how much their rate multiplied, 2024 and 2025 against 2018 to 2022.

Show the data
WordGrowth (x)
underscore3.2
leverages2.7
notably2.7
leveraging2.6
comprehensive2.5
nuanced2.4
showcasing2.3
underscores2.3
foundational2.3
underscoring2.3

Source: arXiv abstracts; scored in scripts/fetch-arxiv-ai-tells.mjs

On GitHub the risers were product words: seamless, streamline, innovative. Here they are the words of a careful summary: underscore in three forms, leverage in two, notably, nuanced, comprehensive. underscore went from 4 uses per million words to 56. Same lexicon, a different half of it, again.

What stayed

For the same ten words, the share of that rise still standing in 2026. Zero is back where it started.

Show the data
WordRise remaining (%)
underscore34
leverages46
notably22
leveraging29
comprehensive17
nuanced35
showcasing18
underscores44
foundational70
underscoring64

Source: arXiv abstracts; scored in scripts/fetch-arxiv-ai-tells.mjs

8 of the 10 have given back more than half of what they gained. Comprehensive ran 114 per million before, 320 at the peak, and 149 now, which leaves 17% of its rise. Notably kept 22%.

What held on tends to have a second job. Foundational is how the field describes its models now. Robust never fell at all — 405 then, 563 now — but it was a term of art before any of this, and a word list cannot tell a claim about a method from a habit of phrasing.

Almost everywhere

Where each field stands now

Flagged-word rate in 2026 against the field's own 2018 to 2022 average.

Show the data
FieldChange (%)
Astrophysics99
Condensed matter33
Statistics20
Econometrics11
Machine learning10
Neuroscience10
Computational linguistics6
Combinatorics-17

Source: arXiv abstracts; scored in scripts/fetch-arxiv-ai-tells.mjs

Every field rose, by 1.4× to 1.9× at the peak, and that includes combinatorics, which barely uses these words at all. Computational linguistics went from 4 per thousand to 7.4 and is back at 4.2. In all, 6 of the 8 are within a quarter of where they started.

Astrophysics is the exception. It rose from 0.97 to 1.84 and in 2026 sits at 1.94, with no retreat. I don’t have an explanation I would defend. It may just be running behind the computing fields.

What the retreat does and doesn’t say

It does not say fewer scientists are using these tools. Nothing here measures use, and I would bet against it. Two other readings fit the chart equally well. The models changed, and the ones people use in 2026 no longer reach for delve. Or the writers changed: once a word is a known tell, it is the first thing an author cuts. A word count cannot separate them, and I suspect it is both.

One thing did not retreat. Abstracts are longer — 160 words in 2018, 181 now — but they were lengthening before 2023 at about the same pace (171 by 2022), so I would not hang anything on it.

The practical point is about the instrument, and I say it as someone who maintains a linter. A list of tells is a photograph of the models of one moment and the prose they produced. Two years on, the same list scores arXiv as nearly back to normal, and the only thing I am sure has gone back to normal is the list. If you are using one to judge a contribution, check the date on it first.

In August I ended on the idea that the tell was ours before it was the models’. The second half of that is now visible too. We took the words back, or the models gave them up, and either way the register moved on while the detectors were still looking for delve.