Adaptive Comparative Judgment as a Tool for Assessing Open-ended Design Problems and Model Eliciting Activities

Applying Criteria to Examples or Learning by Comparison: Effects on Students' Evaluative Judgment and Performance in Writing

“…It inherently activates students to engage with a range of examples of varying quality, doing so in a highly feasible and efficient manner (cf. Bartholomew et al, 2018a). Follow-up research is needed to really get a grip on the potential learning effects of comparative judgment, both to contrast the effects to other instructional approaches such as linking example texts to analytic criteria which is now regularly used in educational practice, but also with regards to contextual factors that are needed for an optimal implementation in practice.…”

Validity of Comparative Judgment Scores: How Assessors Evaluate Aspects of Text Quality When Comparing Argumentative Texts

“…It makes us aware that more research is needed to establish what factors are at play. Pollitt and Murray (1996), Bartholomew et al (2018), andHeldsinger (2019) suggested that the quality of student works is related to the aspects upon which assessors focus. Comparing lower quality performance, lower order aspects as grammar and sentence structure seem to be more salient to assessors, whereas when comparing higher quality performance, the stylistic devices and audience are.…”

“…Next, they responded after each comparison to the query "Can you briefly explain your judgment?" Based on these decision statements, information was gathered on the aspects of text quality that informed the decisions of the assessors (Whitehouse, 2012;Bartholomew et al, 2018;. Each assessor made at least 10 comparisons, with a maximum of 56 comparisons (M = 40.60, SD = 16.16).…”