Automated essay scoring: A review of the field

Lagakis, Paraskevas; Demetriadis, Stavros

doi:10.1109/cits52676.2021.9618476

Cited by 15 publications

(9 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Similar results have been reported in the AES research. While many studies suggest that BERT outperforms other models in AES performance, combining BERT with handcrafted features achieves the current state-of-the-art AES performance (Lagakis & Demetriadis, 2021).…”

Section: Transformersmentioning

confidence: 89%

See 1 more Smart Citation

Exploring the Potential of Using an AI Language Model for Automated Essay Scoring

Mizumoto¹,

Eguchi²

2023

Preprint

View full text Add to dashboard Cite

The widespread adoption of ChatGPT, an AI language model, has the potential to bring about significant changes to the research, teaching, and learning of foreign languages. The present study aims to leverage this technology to perform automated essay scoring (AES) and evaluate its reliability and accuracy. Specifically, we utilized the GPT-3 text-davinci-003 model to automatically score all 12,100 essays contained in the ETS Corpus of Non-Native Written English (TOEFL11) and compared these scores to benchmark levels. The study also explored the extent to which linguistic features influence AES with GPT. The results showed that AES using GPT has a certain level of accuracy and reliability and could provide valuable support for human evaluations. Furthermore, the analysis revealed that utilizing linguistic features could enhance the accuracy of the scoring. These findings suggest that AI language models, such as ChatGPT, can be effectively utilized as AES tools, potentially revolutionizing methods of writing evaluation and feedback in both research and practice. The paper concludes by discussing the practical implications of using GPT for AES and exploring prospective future considerations.

show abstract

Section: Transformersmentioning

confidence: 89%

“…To further expand this line of research, it would be worthwhile to compare our approach with the current best-performing method in AES research, which combines BERT and linguistic features (Lagakis & Demetriadis, 2021).…”

Section: Figurementioning

confidence: 99%

Exploring the Potential of Using an AI Language Model for Automated Essay Scoring

Mizumoto¹,

Eguchi²

2023

Preprint

View full text Add to dashboard Cite

show abstract

“…AI tools also have significant potentials for applications in assessment. Prior to ChatGPT, purpose-built AI tools have been successfully applied for assessment in the context of research and education [ 28 ]. For instance Ref.…”

Section: Literature Reviewmentioning

confidence: 99%

Is AI changing learning and assessment as we know it? Evidence from a ChatGPT experiment and a conceptual framework

Kolade,

Owoseni,

Egbetokun

2024

Heliyon

View full text Add to dashboard Cite

“…Students employ AI to write assignments. Teachers use AI to assess and review them (Lu & Cutumisu, 2021;Lagakis & Demetriadis, 2021). Nobody learns, nobody gains.…”

Section: How Can We Detect Whether An Essay Is Written By a Transform...mentioning

confidence: 99%

Automated Essay Writing: An AIED Opinion

Sharples

2022

Int J Artif Intell Educ

View full text Add to dashboard Cite

This opinion piece emerged from research for the book, Story Machines: How Computers Have Become Creative Writers, by Mike Sharples and Rafael Pérez y Pérez, published by Routledge. While thinking of ways to promote the book, I realised that students could employ AI story generators to write essays. That led me to research automated essay writing, write a Twitter thread that has garnered 43,000 engagements, and author a blog article (Sharples, 2022). The current piece is a revised and expanded version of that article.

show abstract

Automated essay scoring: A review of the field

Cited by 15 publications

References 20 publications

Exploring the Potential of Using an AI Language Model for Automated Essay Scoring

Exploring the Potential of Using an AI Language Model for Automated Essay Scoring

Is AI changing learning and assessment as we know it? Evidence from a ChatGPT experiment and a conceptual framework

Automated Essay Writing: An AIED Opinion

Contact Info

Product

Resources

About