Computer-Based and Paper-and-Pencil Tests: A Study in Calculus for STEM Majors

Abstract

Computer-based testing is an expanding use of technology offering advantages to teachers and students. We studied Calculus II classes for science, technology, engineering, and mathematics majors using different testing modes. Three sections with 324 students employed: paper-and-pencil testing, computer-based testing, and both. Computer tests gave immediate feedback and allowed multiple submissions and pooling. Paper-and-pencil tests (PPTs) required work and explanation allowing inspection of high cognitive demand tasks. Each test mode used the strength of its method. Students were given the same lecture by the same instructor on the same day and the same homework assignments and due dates. The design is quasi-experimental, but students were not aware of the testing mode at registration. Two basic questions examined were as follows: (a) Do paper-and-pencil and computer-based tests (CBTs) measure knowledge and skill in science, technology, engineering, and mathematics Calculus II in a consistent manner? (b) How does the knowledge and skill gained by students in a fully computer-based Calculus II class compare to students in a class requiring pencil-and-paper tests and hence some paper-and-pencil work. These results indicate that CBTs are as consistent with PPTs as CBTs are with themselves. Results are also consistent with classes using PPTs having slightly better outcomes than fully computer-based classes using only computer assessments.

Methods and Forms of Distance Education during the COVID-19 Pandemic: Conclusions from the Literature Review

“…This raises the question of the effectiveness, efficiency, or generally the functionality of testing in two forms: traditional paper-based and computer-assisted. Four researchers from Louisiana State University conducted a study on the above issue on a large sample of undergraduate and graduate science students (Smolinsky et al, 2020).…”

Adapting MAIN to eliciting stories from adults and in a remote context: What do we have to consider, and what do we know?

“…Both can be further differentiated and are referred to with varying terms (e.g., remote/online testing, computer-based testing (CBT) vs. in-person testing, paper-based or paper-and-pencil tests). There are a growing number of studies comparing these two testing settings and discussing the differences in general and regarding the outcomes (to name a few more recent studies from different disciplines: Funda, 2021; Karay et al, 2015;Mcclelland & Cuevas, 2020;Smolinsky, 2020; or for a broader overview Leeson, 2006). For the purpose of this article, I want to give a very broad overview of some of the relevant differences.…”

A Step Toward an Automatic Handwritten Homework Grading System for Mathematics

“…The limited type of the test and assignment that computer can grade also limit the creativity of teachers to design tests, and also limit the cognitive level required to answer the question [9]. From a study, the paper-and-pencil test (PPT) still have slightly better learning outcome than using computer-based system because PPT allows inspection of high cognitive demand tasks [23]. In this study, we are looking for a solution to bridge the gap between the automatic marking by computer and the handwritten, free text homework, especially in mathematics.…”