How we measured AI writing across arXiv, and where the measurement breaks
- We scored the full text of 12,750 arXiv papers and found that about a third of new ones read as machine-written.
- Here is the method, the results, and an honest account of the limitations.
- Share of new arXiv papers flagged as machine-written, 2021 to 2026, at a threshold calibrated so pre-ChatGPT papers flag at 0.4%.
Unverified
- We scored the full text of 12,750 arXiv papers and found that about a third of new ones read as machine-written.
- Here is the method, the results, and an honest account of the limitations.
- Share of new arXiv papers flagged as machine-written, 2021 to 2026, at a threshold calibrated so pre-ChatGPT papers flag at 0.4%.
Sources: Unslop