Impact of Representations in Assessments on Student Performance and Equity

Abstract

Calls for assessments incorporating representations beyond the symbolic level (e.g., chemical reactions and formulas) have encouraged assessment designers to choose from a variety of representations in the design of chemistry assessments. This work expands on prior work in considering how representations are incorporated within assessments. First, students were given assessment items similar in task with common rationales for the design of answer choices with different representations substituted across the items. Second, students were randomly assigned to items identical in prompt, answer choices, and symbolic representation with experimental items supplementing symbolic representation with particulate or mathematical representation. The impact was operationalized as student performance, the performance of at-risk chemistry students scoring in the bottom quartile of the cohort's standardized math test scores, and on the answer choices to which students attend. Substituting symbolic for particulate representation had a significant, negative impact on overall and at-risk student performance and a considerable impact on students' selection of distractors. However, supplementing symbolic with a particulate representation had no discernible impact. Supplementing symbolic representations with tables including a column for "moles" had a significant, positive impact on overall student performance with considerable improvement observed among at-risk students. Students' selection of a distractor representative of a failure to apply a mole-to-mole ratio was reduced when symbolic representations were supplemented with tables. Practical implications for the use of representations in a more equitable assessment design, and as a learning experience for students overall, are described.

A Counterstory to Deficit Narratives of “Underperformance” of Demographically Minoritized Students in General Chemistry

“…These results led us to question what in the classroom environment might be contributing to the trend in grades we saw. A well-known issue in chemistry education practice and research relates to the application of mathematical concepts to chemistry concepts. − The concept of blended sensemaking, where the successful students must draw upon two separate mental resources: mathematical understanding of equations and scientific understanding of phenomena, provides one framework to address these issues. , Because each exam contained a different amount of problems requiring mathematical skills, we decided to look at performance by exam data (Figure ).…”

You Are What You Assess: The Case for Emphasizing Chemistry on Chemistry Assessments

“…One could succeed perfectly well in either of these courses without ever connecting core chemistry ideas to causes for phenomena on high stakes assessments (which make up >45% of students’ grades). By contrast, students with inequitable access to precollege mathematics preparations would (and have) performed inequitably on such assessment tasks. − …”

The Appraisal Principle in Multimedia Learning: Impact of Appraisal Processes, Modality, and Codality

“…Third, it remains unclear how appraisal and attribution processes influence learning with media that differ in modality, codality, and dynamics. Especially, the benefits of dynamics in external representations in supporting supplantation are not or only marginally addressed [46]. Finally, appraisal and attribution towards media processes might additionally influence mental effort and learning outcomes in the media-based learning [47].…”