Collaborative problem solving (ColPS) skills are considered crucial to succeed in work, education, and life in a knowledge-rich society. Despite this relevance and the ample need for valid and reliable assessments to measure ColPS, research on the assessment of ColPS is at its initial stage. The present study attempts to fill this gap by developing and evaluating a novel ColPS task with the help of think-aloud protocols. The task was developed on the basis of a ColPS framework, and principles emphasized in the research literature on students' interaction, collaboration, and problem solving were implemented. A real-world problem mimicking a common teaching and learning situation formed the context of this task. The empirical evidence obtained from the think-aloud protocols of twelve Norwegian students displayed the strengths and weaknesses of the task, and strengthened the feasibility to assess ColPS. Implications for the future design of ColPS tasks are discussed.Keywords: Assessment and teaching of 21 st century skills (ATC21S); Collaborative problem solving; Computer-based assessment; Educational technology; Think-aloud protocol al., 2016). Yet, the challenge lies in "how to capture more of this (social skills) in an automated way that lends itself to coding and scoring" (Care et al., 2016, p. 24).Against this background, the present study aims to provide insights into students' interactions, communication, collaboration, and problem solving skills in a digital environment at lower-secondary level. The overarching aim is to investigate to what extent a newly developed ColPS task facilitates and captures students' abilities to interact with each other and solve a problem within an assessment; moreover, we describe these processes on the basis of an underlying framework. We examine video data of twelve think-aloud protocols (TAP), while students were taking a performance-based test.
Theoretical Framework
Twenty-First Century SkillsThe ubiquitous increase of ICT has affected the pace at which individuals communicate, exchange information, and collaborate across social digital networks. This change requires, to a great extent, competences in processing various forms of information, interacting with others, and solving problems which may be distributed across several contexts (e.g., school, workplace, home and social networks). These competences have been labeled as "21 st century skills" and comprise