Style, sentiment, and quality of undergraduate writing in the AI era: A cross-sectional and longitudinal analysis of 4,820 authentic empirical reports
Abstract
As generative artificial intelligence (GenAI) becomes widespread in education, its influence on students' academic practice raises concern. We conducted pre-registered analyses of 4820 empirical reports authored by 2000 psychology undergraduates (2016–2025) to examine how ChatGPT's launch in November 2022 may influence the style, sentiment, and quality of students' writing. Following ChatGPT's release, prevalence of ChatGPT-associated lexical markers (e.g., delve, intricate) surged until 2024, then declined in 2025, possibly due to some students actively masking GenAI traces. Writing style (indexed by lexical diversity/density/sophistication, nominalisation, readability) became increasingly formal post-ChatGPT, diverging from predicted/historical trends. Consistent with GenAI's positivity bias, sentiment also became more positive, independent of a report's topic or the statistical significance of the reported results, raising questions about its potential impact on students' voice, creativity, and critical thinking. Despite the stylistic changes, writing quality (indexed by grades and feedback) showed no discernible shifts. In an exploratory analysis, we asked GPT models to rewrite pre-ChatGPT reports, and these GPT-rewritten texts resembled post-ChatGPT reports more in style and sentiment, providing evidence for GPT models driving the observed shifts. Finally, no students disclosed AI use despite clear guidelines, highlighting the ineffectiveness of voluntary disclosure and the need for more enforceable policy. Overall, our findings indicate that a growing proportion of undergraduate students are incorporating GenAI in their written assignments, producing work that exhibits stylistic and tonal features characteristic of ChatGPT-generated text.
Identifier Metadata
| Identifier | 110.0845/CON.2026.00816 |
| Canonical | mdoi:110.0845/CON.2026.00816 |
| Resolver URL | https://mdoi.org/110.0845/CON.2026.00816 |
| Resource URL | Open resource |
| Document URL | Open document |
| Content Type | Article |
| Authors | Artificial intelligence (AI), Writing style, Sentiment, Positivity bias, Writing quality |
| Year | 2025 |
| Depositor | Convergence Chronicles Organisation |
| Prefix | 110.0845 |
| Registered | July 29, 2026 |
| Updated | July 29, 2026 |
| Status | Active |
| Visibility | Public |
Cite This Identifier
APA 7th Edition
Click to copy
MLA 9th Edition
Click to copy
Chicago 17th Edition
Click to copy
BibTeX
Click to copy
Persistent Identifier
mdoi:110.0845/CON.2026.00816Click to copy