Automated Code Assessment for Education: Review, Classification and Perspectives on Techniques and Tools

Abstract

Automatically assessing code for learning purposes is a challenging goal to achieve. On-site courses and online ones developed for distance learning both require automated ways to grade learners’ programs to be able to scale and manage a large public with a limited teaching staff. This paper reviews recent automated code assessment systems. It proposes a systematic review of the possible analyses they can perform with the associated techniques, the kinds of produced feedback and the ways they are integrated in the learning process. It then discusses the key challenges for the development of new automated code assessment systems and the interaction with human grading. In conclusion, the paper draws several recommendations for new research directions and for possible improvements for automatic code assessment.

A Step Toward an Automatic Handwritten Homework Grading System for Mathematics

“…For free-text input, the system has to analyze sentence structure and extract keywords that match the key answer [25]. Another field of practical use is the automatic code assessment, where the system can analyze the source code in a programming language and return the evaluation in terms of syntax, plagiarism, semantic, performance, or quality [4,5]. There are disadvantages of AHM when compared to human marking.…”

Software engineering teacher networks in Finland - what motivates teachers to collaborate?

“…The different implementations of these courses range from pure lecture courses to realisations that heavily rely on automatically assessed assignments (AAA). The assignments can include simple multiple choice questions, but also smart content such as automatically assessed programming exercies [6,9,12] and algorithm simulation exercises [11,13]. Textbooks.…”

Automated Correction for Trace Tables in a CS1 Course

“…In recent years, the number of courses offered in the remote modality has increased considerably, especially during and after the COVID-19 pandemic [Combéfis 2022]. The Information Processing (CS1) course at UFABC aims to teach programming to students and is offered both in-person and remotely.…”

“…In practical components of computer science courses, such as introductory programming classes like CS1, activities with automatic correction are commonly used [Combéfis 2022]. However, as discussed in [Paiva et al 2022], automatic correction is more challenging to implement in the theoretical component.…”