Automated Essay Scoring Systems

Ifenthaler, Dirk

doi:10.1007/978-981-19-0351-9_59-1

Cited by 13 publications

(12 citation statements)

References 47 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The system includes security measures to prevent cheating, such as timed exams, random question order, and IP tracking. Students receive instant feedback on exam results, allowing them to see their strengths and weaknesses and improve performance (Ifenthaler, 2022). Exams (Shokri, Halupka, & Pauwels, 2021) can be customized to meet specific needs of each course or subject, allowing for flexibility in the design and delivery of exams.…”

Section: E-examination Systemmentioning

confidence: 99%

The Digital Leadership in Kp Schools Over Digital Transformation: Evidence From Emerging Economy

Khan,

Shaheen,

Jahanzeb

2023

JSSD

View full text Add to dashboard Cite

Leadership skills that are particularly important in digital era include the ability to think strategically, drive change and foster culture of innovation. Bases on the detailed literature it is the first ever study to investigate digital leadership based on various characteristics proposed by (Karakose, Polat, & Papadakis, 2021) the qualitative study conducted in the work context of turkey. Based on the literature it is concluded that digital leadership is diverse phenomena and it cannot be measured by just defining concept and tries to measure it by limited number of items as most of the previous researchers. Based on detail literature it is evident that digital leadership is phenomena that is based on many attributes namely (digital technology usage aim and reasons), for or against (digital transformation in schools), reasons for and against (technological based professional development), reason for and against (digital learning culture) & digital leadership skills/ abilities as well as characteristics. The results offered valuable information in reaching the conclusion and making certain recommendations to policy makers & future researchers.

show abstract

Section: E-examination Systemmentioning

confidence: 99%

The Digital Leadership in Kp Schools Over Digital Transformation: Evidence From Emerging Economy

Khan,

Shaheen,

Jahanzeb

2023

JSSD

View full text Add to dashboard Cite

show abstract

“…Nowadays, it is seen that especially Computer Adaptive Testing (CAT) and Computerized Classification Testing (CCT) applications are developed and presented frequently as a technology and analytics enhanced assessment system. Technology and analytics-enhanced assessment systems are required to include flexible, adaptable, automated reports for the management of large amounts of data, analysis of unstructured data, immediate feedback to both instructors and learners, and educational decision-making (Ifenthaler, 2022).…”

Section: Introductionmentioning

confidence: 99%

Determining Learners’ Behavioral Patterns in a Technology and Analytics Enhanced Assessment Environment

Sahin,

Ifenthaler

2024

Cognition and Exploratory Learning in the Digital Age

Self Cite

View full text Add to dashboard Cite

Within digitally-supported learning environments, learners need to observe themselves so that they can reflect on their strengths and weaknesses and take a step toward autonomous learning. Within the scope of this research, a technology and analytics enhanced assessment environment in which students can assess themselves was implemented and tested. In order to determine N = 108 students' ability to use the assessment environment, behavioral patterns were determined based on their individual characteristics, system interactions, lesson performances, achievement motivation, confidence, and study interest. Findings indicate different system usage and behavioral engagement with the assessment system. The outcomes of this design-based research project indicate hints on how such assessment systems can be made more effective in future implementation stages.

show abstract

“…The AES tools' correlations and agreement with human raters have become fairly high (Ifenthaler, 2022). State-of-the-art models report quadratic weighted Kappas ranging from .57 to .80, with most in the low .70's, evidencing substantial agreement between the models and human raters (Beseiso et al, 2021;Uto et al, 2023).…”

Section: Introductionmentioning

confidence: 99%

Can AI Provide Useful Holistic Essay Scoring?

Tate,

Steiss,

Bailey

et al. 2023

Preprint

View full text Add to dashboard Cite

Researchers have sought for decades to automate holistic essay scoring. Over the years, these programs have improved significantly. However, accuracy requires significant amounts of training on human-scored texts—reducing the expediency and usefulness of such programs for routine uses by teachers across the nation on non-standardized prompts. This study analyzes the output of multiple versions of ChatGPT scoring of secondary student essays from three extant corpora and compares it to quality human ratings. We find that the current iteration of ChatGPT scoring is not statistically significantly different from human scoring, but exact agreement with humans is still difficult. Consistency and agreement within one point, however, is achievable and may be sufficient for low-stakes, formative assessment purposes.

show abstract

Automated Essay Scoring Systems

Cited by 13 publications

References 47 publications

The Digital Leadership in Kp Schools Over Digital Transformation: Evidence From Emerging Economy

The Digital Leadership in Kp Schools Over Digital Transformation: Evidence From Emerging Economy

Determining Learners’ Behavioral Patterns in a Technology and Analytics Enhanced Assessment Environment

Can AI Provide Useful Holistic Essay Scoring?

Contact Info

Product

Resources

About