Trends the use of Artificial Intelligence techniques for peer assessment

Mendoza, Lorena Bowen; Ortega, Maricela Pinargote; Hormaza, Jaime Meza; Ventura, Sebastián

doi:10.1145/3410352.3410837

Cited by 2 publications

(1 citation statement)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A peer judges the quality and characteristics of the work, giving students an active role in this process (Ketonen et al, 2020). Research by Bowen et al (2020) reveals that the use of rubrics in peer evaluation processes is strongly related to technology, especially with the integration of ICT and electronic rubrics that better support decision-making in education.…”

Section: Introductionmentioning

confidence: 99%

Design of peer assessment rubrics for ICT topics

et al. 2021

View full text Add to dashboard Cite

Peer evaluation consists of the evaluation of students by their peers following criteria or rubrics provided by the teacher, where the way to evaluate students is specified so that they achieve the desired competencies. The quality of the measurement instrument must meet two essential criteria: validity and reliability. In this research, we explored the educational value of peer evaluation rubrics by analyzing the quality of the rubric through the study of content validity, reliability, and internal consistency. Our main purpose was to design an appropriate rubric to grade tasks in the field of information engineering, as well as performing content validation through a group of experts. It was carried out in three phases: 1) construction of a rubric, with its criteria, characteristics, and levels of achievement; 2) content validation by five experts in the field, and 3) application of the rubric to ascertain students' perceptions and satisfaction with its validity. The relevance of the criteria and the definition of their characteristics obtained a score higher than 3.75/4 on a Likert scale. The content validity values (CVR), content validity index (CVI), and general content validity index (GIVC) gave maximum values of + 1. The results obtained indicate that the rubric is adequate, with Aiken's V higher than V 0.87 in all its criteria. The rubric was applied to 326 students of 4 subjects. Cronbach's alpha was used to calculate the reliability of the rubric, obtaining a value of 0.839. The students' perception of validity and satisfaction with the rubric was higher than 0.78. As future work, we intend to design a rubric validation engine according to the applied procedure.

show abstract

Section: Introductionmentioning

confidence: 99%