Analyzing the decline of student scores over time in self‐scheduled asynchronous exams

Abstract

Background When students are given a choice of when to take an exam in engineering and computing courses, it has been previously observed that average exam scores generally decline over the exam period. This trend may have implications both for the design of interventions to improve student learning and for data analysis to detect collaborative cheating. Purpose/Hypothesis We hypothesize that average exam scores decline over the exam period primarily due to self‐selection effects, where weaker students tend to choose exam times later in the exam period, while stronger students are more likely to choose earlier times. Design/Method We collected 31,673 exam records over four semesters from six undergraduate engineering and computing courses that had both synchronous exams (all students at the same time) and asynchronous exams (students choose a time). We analyzed student exam time choice and asynchronous exam scores, using synchronous exam scores in the same course as a control variable. Results We find that students with lower scores on synchronous exams generally elect to take asynchronous exams later and that controlling for student ability (via synchronous exams) removes 70% of the decline observed in average asynchronous exam scores over the exam period but does not eliminate the downward trend with time. Conclusions We conclude that self‐selection effects are primarily responsible for exam score declines over time, that exam time selection is unlikely to be a useful target for interventions to improve performance, and that there is no evidence for widespread collaborative cheating in the dataset used in this research.

Promoting Academic Integrity and Student Learning in Online Biology Courses

“…This study also found that students who took quizzes between midnight and 8 a.m. did worse than students who did not take the quiz late at night and that weaker students tended to take the quiz later in the provided window, leading to lower scores ( 56 ). These results are consistent with a limited number of studies of student performance in other fields ( 57 , 58 ); however, most of these studies also relied on other strategies to deter cheating (randomized questions from a bank, online software, etc. ), and there have been no studies that I am aware of investigating the timing of exams on the rates of cheating or the impact on student performance in biology courses since the pandemic began.…”

Comparison of Grade Replacement and Weighted Averages for Second-Chance Exams

“…We also calculated linear regression coefficients to examine whether weaker students prefer to take exams later in the exam window as shown in previous studies [3,8].…”

“…Furthermore, when students are allowed to pick their exam times, exam scores generally decrease throughout the exam period [3,6]. A recent study suggests this decrease is largely due to weaker students, on average, taking the exam later in the exam period than stronger students [8]. When students take exams asynchronously, but are assigned their exam times, previous work has found that exam scores are stable within the exam period [19].…”

Aligning classroom assessment with engineering practice: A design‐based research study of a two‐stage exam with authentic assessment

“…These assessments can take many forms including the use of data banks of multiple-choice questions with automated marking and feedback (B. Chen, West, & Zilles, 2019;Cukuši c et al, 2014;Mitkov et al, 2006), the use of learning analytics to increase student success (Larrabee Sønderlund et al, 2019), and embedded assessments immersed in serious games (Caballero-Hern andez et al, 2017;Kim & Shute, 2015). Supporters see the potential of technology to enable learning environments that provide real-time feedback and scalable and personalized support.…”