We investigated the effects of computerized adaptive testing (CAT) versus computerized fixed item testing (FIT) of reasoning ability on current motivation in terms of situational fear of failure and subjective probability of success, as well as flow. A group of 174 students (aged 15–21) from two German secondary schools was presented either a CAT or a FIT version of a matrices test; motivational variables were assessed during a short break in testing. More situational fear of failure and less subjective probability of success were reported using CAT compared to FIT. Self-reported flow did not differ between test mode conditions. When we addressed the hypothesis that adaptive testing is equally motivating for both high and lower performers, test performance appeared to moderate the relationship of test mode and subjective probability of success: Only during FIT was subjective probability of success higher with lower test performance. This moderation effect was also revealed for the relationship of test mode and flow. However, as average reported motivation was lower during CAT, results contradict assumptions of enhanced motivation during CAT. Results are discussed in relation to self-concept relevance of testing domains and with reference to test fairness.
of the College Board, graces this issue's cover. This richly detailed visual depicts examinees' reading abilities across the multiple dimensions of a large-scale measure of reading ability. These creative researchers described their work this way. This visual answers the following question: "Based on ex-aminees' performance on 40+ reading items, is it possible to visually identify clusters of examinees that have different reading skills?" The plot answers the question by showing three panels: the outer two visualize different views of a cluster analysis , and the middle panel visualizes differences in skills for the identified clusters. The plots show test takers' strengths and weaknesses in their reading abilities for a large-scale assessment. The outer panels show different views of low-dimensional clustering of n = 4,930 test takers' performance on 40+ reading items, and the middle panel represents reading skill profiles of eight clusters of test takers. The outer panels are visual representations of n = 4,930 test takers' performances on reading items of a large-scale assessment. With more than 40 items, it is typically difficult to visualize test takers' individual performances, especially when attempting to identify differences in subgroups of test takers by skill. Using an innovative approach, the researchers first reduced the data into three dimensions using T-distributed stochastic neighbor embedding (T-SNE), a relatively new machine learning technique that facilitates visualization of high-dimensional data in low dimensions. Then they applied model-based cluster analysis based on Gaussian mixture mod-eling, and classified all test takers into eight clusters based on item-level performance. Finally, they generated an interactive 3D plot using the R plotly package (R Core Team, 2016). The outer panels contain four different angles of the 3D plot. The middle panel shows the skill profiles of the eight clusters. Content experts theorized three primary skills for reading, and then identified which skill is primarily measured by each item. We calculated each cluster's mean proportion of correct responses for each skill and then plotted the cluster profiles. The eight profiles have various patterns, but the major difference lies in the elevation/level, which indicates that the three skills are highly correlated and compensatory. The visualization confirmed that the total reading score was a sufficient metric for understanding examinee achievement, and that clusters of similar-performing students were mainly differentiated by their "level" of performance and not by individual strengths or weaknesses in particular skills.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.