Integrating computer science (CS) into school curricula has become a worldwide preoccupation. Therefore, we present a CS and Robotics integration model and its validation through a large-scale pilot study in the administrative region of the Canton Vaud in Switzerland. Approximately 350 primary school teachers followed a mandatory CS continuing professional development program (CPD) of adapted format with a curriculum scaffolded by instruction modality. This included CS Unplugged activities that aim to teach CS concepts without the use of screens, and Robotics Unplugged activities that employed physical robots, without screens, to learn about robotics and CS concepts. Teachers evaluated positively the CPD and their representation of CS improved. Voluntary adoption rates reached 97% during the CPD and 80% the following year. These results combined with the underpinning literature support the generalisability of the model to other contexts.

Educational Robotics (ER) has the potential to provide significant benefits to education, provided an increase in outreach by transitioning from the extra-curricular initiatives in which ER has thrived to formal education. As Computer Science (CS) Education is undergoing curricular reforms worldwide, the present study addresses the case of a Digital Education reform that included ER as a means to teach core CS concepts. Approximately 350 teachers from the first four grades of primary school participated in a mandatory two-year continuing professional development (CPD) program. The first year of the program was dedicated to CS and introduced teachers to CS Unplugged (CSU) and Robotics Unplugged (RU) activities. As such, we analyse the interplay between these activities and focus on teachers’ voluntary adoption of the proposed content in classrooms. This is complemented by an analysis of their perception and recommendation of ER. The findings highlight three main points. Firstly, ER benefits from the integration in the CS CPD, as this provides the necessary traction to introduce ER into teacher practices (the teachers freely devoted 2275 h to ER activities in their classrooms, over two years). Secondly, the presence of ER activities in the CS-CPD allows a higher proportion of teachers to adopt the CS content, as there are teachers that favour one type of activity over the other. Finally, the globally positive perception of ER registered in this study is relevant for two reasons: teachers were not voluntarily participating in the CPD, and results did not differ between pioneers and novices.

No abstract

With the increasing importance of Computational Thinking (CT) at all levels of education, it is essential to have valid and reliable assessments. Currently, there is a lack of such assessments in upper primary school. That is why we present the development and validation of the competent CT test (cCTt), an unplugged CT test targeting 7–9 year-old students. In the first phase, 37 experts evaluated the validity of the cCTt through a survey and focus group. In the second phase, the test was administered to 1519 students. We employed Classical Test Theory, Item Response Theory, and Confirmatory Factor Analysis to assess the instruments’ psychometric properties. The expert evaluation indicates that the cCTt shows good face, construct, and content validity. Furthermore, the psychometric analysis of the student data demonstrates adequate reliability, difficulty, and discriminability for the target age groups. Finally, shortened variants of the test are established through Confirmatory Factor Analysis. To conclude, the proposed cCTt is a valid and reliable instrument, for use by researchers and educators alike, which expands the portfolio of validated CT assessments across compulsory education. Future assessments looking at capturing CT in a more exhaustive manner might consider combining the cCTt with other forms of assessments.

No abstract

The introduction of computing education into curricula worldwide requires multi-year assessments to evaluate the long-term impact on learning. However, no single Computational Thinking (CT) assessment spans primary school, and no group of CT assessments provides a means of transitioning between instruments. This study therefore investigated whether the competent CT test (cCTt) could evaluate learning reliably from grades 3 to 6 (ages 7-11) using data from 2709 students. The psychometric analysis employed Classical Test Theory, normalised z-scoring, Item Response Theory, including Differential Item Functioning and PISA's methodology to establish proficiency levels. The findings indicate that the cCTt is valid, reliable and gender-fair for grades 3-6, although more complex items would be beneficial for grades 5-6. Grade-specific proficiency levels are provided to help tailor interventions, with a normalised scoring system to compare students across and between grades, and help establish transitions between instruments. To improve the utility of CT assessments among researchers, educators and practitioners, the findings emphasise the importance of i) developing and validating gender-fair, grade-specific, instruments aligned with students' cognitive maturation, and providing ii) proficiency levels, and iii) equivalency scales to transition between assessments. To conclude, the study provides insight into the design of longitudinal developmentally appropriate assessments and interventions.

IntroductionWith the increasing amount of research around Computational Thinking (CT) and endeavors introducing CT into curricula worldwide, assessing CT at all levels of formal education is of utmost importance to ensure that CT-related learning objectives are met. This has contributed to a progressive increase in the number of validated and reliable CT assessments for K-12, including primary school. Researchers and practitioners are thus required to choose among multiple instruments, often overlapping in their age validity.MethodsIn this study, we compare the psychometric properties of two of these instruments: the Beginners' CT test (BCTt), developed for grades 1–6, and the competent CT test (cCTt), validated for grades 3–4. Classical Test Theory and Item Response Theory (IRT) were employed on data acquired from 575 students in grades 3–4 to compare the properties of the two instruments and refine the limits of their validity.ResultsThe findings (i) establish the detailed psychometric properties of the BCTt in grades 3–4 for the first time, and (ii) through a comparison with students from the same country, indicate that the cCTt should be preferred for grades 3–4 as the cCTt is able to discriminate between students of low and medium ability. Conversely, while the BCTt, which is easier, shows a ceiling effect, it is better suited to discriminate between students in the low ability range. For these grades, the BCTt can thus be employed as a screening mechanism to identify low ability students.DiscussionIn addition to providing recomendations for use of these instruments, the findings highlight the importance of comparing the psychometric properties of existing assessments, so that researchers and practitioners, including teachers and policy makers involved in digital education curricular reforms, may take informed decisions when selecting assessments.

Context    With the introduction of computer science (CS) into curricula worldwide, teachers’ adoption of CS-pedagogical content is essential to ensure the long-term success of reform initiatives. Continuing Professional Development (CPD) programs play a key role in this process. Unfortunately, adoption is seldom evaluated in CS-CPDs, or CPDs in general. The result is a dearth of studies i) modelling teachers’ adoption of CS-pedagogical content, or ii) investigating factors influencing the uptake of this new discipline. Both aspects are crucial to design and characterise successful CPD programs. Objectives    We thus propose the Teachers’ Adoption of CS (TACS) model to investigate factors influencing the adoption of CS-pedagogical content by teachers who are following a mandatory CS-CPD program. More specifically, the model proposes that contextual factors (e.g. age, gender, and general teaching experience), prior factors (e.g. experience, and CS perception), and acceptance factors (e.g. interest, and self-efficacy) may impact teachers’ adoption of CS-pedagogical content. Methods    The study included 180 grade 5-6 teachers (students aged 9-11) that were following a mandatory CS-CPD program. The CS-CPD program involved participation in three day-long sessions distributed over the 2019-2020 academic year. In between sessions, with the support of instructional coaches in the schools, teachers were encouraged, but not required, to adopt the CS-pedagogical content. Therefore, during the CPD, and employing surveys based on the TACS model, we evaluated teachers’ adoption of the proposed content and investigated how the different factors influenced it. Results    At the PD-level, the results indicate that self-efficacy and interest queried during the CS-CPD are indicative of CS-pedagogical content adoption. To shed more light on the relationship between these metrics, a more in-depth analysis was conducted with n=92 teachers whose responses could be matched between sessions. While interest relates to how teachers adopt CS-pedagogical content overall, both interest and self-efficacy are necessary to ensure the likelihood of a specific activity being adopted. Finally, individual teacher characteristics appear to impact adoption, with teachers with low ICT experience requiring onboarding, while middle-aged teachers require convincing to adopt CS-pedagogical content. Conclusion    Three takeaways emerge from the study. First, the analyses confirm the foundation of the TACS model. Second, the findings establish the key role that interest plays in said model. Finally, the results support the relationship between the contextual, prior and acceptance factors on the adoption of primary school CS-pedagogical content.