A Quantitative Study of a Software Tool that Supports a Part-Complete Solution Method on Learning Outcomes

Abstract

Executive SummaryThis paper reports on the findings from a quantitative research study into the use of a software tool that was built to support a part-complete solution method (PCSM) for the learning of computer programming. The use of part-complete solutions to programming problems is one of the methods that can be used to reduce the cognitive load that students experience during their learning.The tool that was built is a code restructuring tool known as CORT. It permits the display of a part-complete solution to a programming task together with a set of possible lines of code that can be used to "fill-in" the solution. Students can then easily manipulate the programming lines within CORT and then test their solutions within a traditional development environment such as Microsoft's Visual Studio.An inquiry into CORT's effect on student learning outcomes took place over a period of 14 weeks at an Australian university. Two student groups participated in an introductory programming unit, one of which utilized the CORT system whilst the other acted as a control group. Data were collected on student background, time taken to complete programming tasks, the amount of help that students required, and student learning outcomes.The data were analysed using a statistical package, and it was found that there was no significant difference in the relative levels of achievement between students in the two groups. However the results did indicate that students in the CORT group spent significantly less time and required significantly less help than the students in the control group. This suggests that if the CORT students had spent extra time on further programming tasks such that their overall time had been equal to that of the non-CORT students, then they may have achieved higher learning outcomes. Also the fact that the CORT students required less help than the control group suggests that the use of CORT might be beneficial to students studying programming in external mode where access to tutor help is more problematic.The data were also analysed to determine if there were any differences with respect to student achievement between the sub-groups of: previous achievement level; age; computer literacy level; previous programming experience; and gender. The analysis revealed that the CORT students who were either younger, only moderately computer literate, or without any previous proMaterial published as part of this publication, either on-line or in print, is copyrighted by the Informing Science Institute. Permission to make digital or paper copy of part or all of these works for personal or classroom use is granted without fee provided that the copies are not made or distributed for profit or commercial advantage AND that copies 1) bear this notice in full and 2) give the full citation on the first page. It is permissible to abstract these works so long as credit is given. To copy in all other cases or to republish or to post on a server or to redistribute to lists requires specific permission and payment of a fee. Cont...

Assessing the usability of students object-oriented language with first-year IT students

“…Testing a novice programming language on first-year university students is not uncommon (Dougherty, 2007;Lorenzen & Sattar, 2008;Powers et al, 2007;Garner, 2009). It was decided to recruit at the start of the second semester, since students would have been introduced to the basics of procedural programming at this point, but would not have learned any OO concepts.…”

Analyzing coding behaviour of novice programmers in different instructional settings: Creating vs. Debugging

“…(2) What does the program do now? (3) At what point in the program does it go wrong? (4) How can we fix the error?…”

“…Additionally, they showed that learners taught using the code generation method scored lower on a statements knowledge test than students who were taught using code completion problems. Moreover, in [3], it was shown that teaching programming using the generation method required more time and triggered more questions from the learners than the part-complete solution method they describe. The part-complete solution method provides the learners with an incomplete program and requires them to add an element.…”

Koios: Design, Development, and Evaluation of an Educational Visual Tool for Greek Novice Programmers

“…Many modern educational programming environments, like Scratch (Resnick et al., 2009), Alice (Bishop-Clark et al., 2007), and Greenfoot (Kölling, 2010), have been influenced (indirectly) by principles of constructivism, although constructivism is often not explicitly referenced as part of their design rationale. Based on CLT, other environments for novice programmers like CORT (Garner, 2009), ReadJava simulator (Williams, 2014), XLogoOnline (Hromkovič, Serafini, & Staub, 2017) were designed explicitly to reduce cognitive load on its users. Moons and De Backer (2013) combined principles of these two learning theories in the design of their interactive learning environment for introductory programming, and its evaluation showed that it facilitated its users in understanding programming constructs most students find difficult.…”