Computer Versus Paper-Based Testing: Are They Equivalent When it Comes to Working Memory?

Abstract

School systems across the country are transitioning from paper-based testing (PBT) to computer-based testing (CBT). As this technological shift occurs, more research is necessary to understand the practical and performance implications of administering CBTs. Currently, there is a paucity of research using CBTs to examine working memory (WM) performance, even though CBTs may negatively influence performance. The present study compared a WM CBT and PBT and found enhanced WM performance on the PBT across several verbal and visuospatial WM tests. This pattern was evident even after age was controlled, indicating that test mode effects were persistent across ages (4-11 years). CBTs on WM performance may yield lower scores due to developmental WM differences, increased cognitive workload, test mode effects stemming from individual access to technology, and participant characteristics, such as developmental, biological, or gender differences. The presence of divergent WM in CBT and PBT indicates the need for additional options for children at risk of academic failure because of testing modality.

Evidence of Validity for a Newly Developed Digital Cognitive Test Battery

“…This is problematic, because it cannot be assumed that paper and digital versions of the same test will measure the same underlying cognitive domains (Bauer et al, 2012;American Educational Research Association, 2014). Currently, the evidence for agreement between paper and digital tests is mixed at best, with some studies showing no performance differences between paper-and-pencil and digital tests (Williams and McCord, 2006;Parsey and Schmitter-Edgecombe, 2013) while others demonstrate substantial differences (Williams and Noyes, 2007;Riordan et al, 2013;Feenstra et al, 2017;Carpenter and Alloway, 2018).…”

Digital Technologies in Education: Problems and Prospects for “Moscow Electronic School” Project Implementation

“…The results of the study are in line with international practice of digital technology implementation. In particular, Rachel Carpenter and Tracy Alloway consider it is necessary to pay special attention to the workload specifics, the level of computer literacy, media competence and the individual characteristics of teachers (Carpenter, Alloway, 2019).…”

The Semiotics of Test Design: Conceptual Framework on Optimal Item Features in Educational Assessment Across Cultural Groups, Countries, and Languages

“…A recurrent issue in testing is the increase in an item's extraneous cognitive load that takes place when, in addition to thinking about the problems posed, examinees need to figure out how they need to give their responses to items (Clariana and Wallace, 2002;Carpenter and Alloway, 2018). This concern arises, for example, in online testing endeavors that involve populations with varying levels of familiarity with computers.…”