No abstract

No abstract

SummaryThis study investigated students' decision‐making processes in a knowledge‐assessing multiple‐choice (MC) test using eye‐tracking methodology. More precisely, the gaze bias effect (more attention to more preferred options) and its relation to domain knowledge were the focus of the study. Eye movements of students with high (HPK) and low (LPK) prior domain knowledge were recorded while they solved 21 MC items. Afterwards, students rated every answer option according to their subjective preference. As expected, both HPK and LPK students showed a gaze bias towards subjectively preferred answer options, whereby HPK students spent more time on objectively correct answers. Furthermore, a fine‐grained time‐course analysis showed similar patterns of attention distribution over time for both HPK and LPK students, when focusing on subjective preference levels. Thus, these data offer a new perspective on knowledge‐related MC item solving and provide evidence for the generalizability of the gaze bias effect across decision tasks. Copyright © 2014 John Wiley & Sons, Ltd.

Abstract. Pictures are often used in standardized educational large-scale assessment (LSA), but their impact on test parameters has received little attention up until now. Even less is known about pictures’ affective effects on students in testing (i.e., test-taking pleasure and motivation). However, such knowledge is crucial for a focused application of multiple representations in LSA. Therefore, this study investigated how adding representational pictures (RPs) to text-based item stems affects (1) item difficulty and (2) students’ test-taking pleasure. An experimental study with N = 305 schoolchildren was conducted, using 48 manipulated parallel science items (text-only vs. text-picture) in a rotated multimatrix design to realize within-subject measures. Students’ general cognitive abilities, reading abilities, and background variables were assessed to consider potential interactions between RPs’ effects and students’ performance. Students also rated their item-solving pleasure for each item. Results from item-response theory (IRT) model comparisons showed that RPs only reduced item difficulty when pictures visualized information mandatory for solving the task, while RPs substantially enhanced students’ test-taking pleasure even when they visualized optional context information. Overall, our findings suggest that RPs have a positive cognitive and affective influence on students’ performance in LSA (i.e., multimedia effect in testing) and should be considered more frequently.

The first wave of the COVID-19 pandemic disrupted regular classes in spring 2020.Temporary school closures supposedly led to a considerable learning loss, particularly for low-achieving students. Schools in Baden-Württemberg, Germany, were closed for two months. Although distance learning was implemented, students spent less time learning.Additionally, teachers were faced with organizational and technological challenges of remote learning environments. The present study investigates the competencies of fifthgraders, using large-scale assessment results in reading and mathematics from annual mandatory tests in September (each n > 80,000). In line with studies from other countries, competence scores were slightly lower in 2020 compared with the three previous years (-0.07 standard deviations for reading comprehension, -0.09 for operations, and -0.03 for numbers). Low-achieving readers managed to attain pre-pandemic competence levels.Regarding mathematics competencies, low-achieving students seem to have a learning backlog that deserves attention in future education. School characteristic such as the average socio-cultural capital and the proportion of students with migration background played a minor role in mediating the schools' learning loss. Still, lower socio-cultural capital was positively associated with larger learning loss in mathematics.