Artificial intelligence (AI) has proven its prowess in academia, outperforming real students in university exams, according to a recent study from the University of Reading.
Researchers found that AI-generated answers on undergraduate psychology exams consistently outperformed those of real students, often going unnoticed by graders.
The study used ChatGPT, an artificial intelligence tool, to create answers for module exams by creating 33 fictitious student profiles. The results revealed that AI-written essays scored on average half a mark higher than human-written essays. Alarmingly, 94% of these AI-written essays did not raise any suspicion among graders, highlighting their almost invisible footprint in assessment processes. The study, published in PLOS ONE, suggests that the 6% detection rate may overestimate AI’s detection capabilities.
Associate Professor Peter Scarfe and Professor Etienne Roesch, who led the study, highlighted the implications for the integrity of education around the world. Dr Scarfe noted the move away from traditional exams to promote inclusion, but warned of the risk that AI could compromise the fairness of assessments.
While a return to handwritten exams is not an option, Dr Scarfe called for rapid global action to address the changing role of AI in education. The study found that AI excelled in early undergraduate modules but lagged behind in more complex third-year exams requiring abstract reasoning.
The study also highlighted broader concerns about the impact of AI on education. At the University of Glasgow, in-person exams have been reintroduced for some courses in response to these challenges. A separate study reported by The Guardian found that while many undergraduates use AI to help them write their essays, only a minority admit to inserting unedited AI content directly into assessments.
The University of Reading’s findings serve as a wake-up call to educators, who are calling for a re-evaluation of assessment strategies in the context of advances in AI technologies. As AI continues to evolve, ensuring the integrity and fairness of academic assessments remains a key priority for the education sector.
First published: June 27, 2024 | 5:51 p.m. IST
