Agent‐Based Modeling of Collaborative Problem Solving

Abstract

Collaborative problem solving (CPS) is a critical competency in a variety of contexts, including the workplace, school, and home. However, only recently have assessment and curriculum reformers begun to focus to a greater extent on the acquisition and development of CPS skill. One of the major challenges in psychometric modeling of CPS is collecting large‐scale data on teams and processes. In this study, we explore the use of agent‐based modeling (ABM) to model the CPS process, test the sensitivity of outcomes to different population characteristics, and generate simulated data that can provide a novel means by which to refine and develop psychometric models. Methods of adapting trait‐based stochastic processes to a specific task are described, and preliminary results are presented.

Computational Psychometrics for the Measurement of Collaborative Problem Solving Skills

“…There are stochastic models (point processes, for example) that can be used to model the temporal dynamics of the CPS tasks (von Davier and Halpin, 2013), or hidden Markov models (Soller and Stevens, 2007); there are also models based on the cognitive or social theories such as Agent-based modeling (Bergner et al, 2015) and Markov Decision Process, which is a cognitive model with parameters that describe the goals or beliefs of the agents and which defines behavior as an optimization of expected rewards based on current beliefs about the world (LaMar, 2014). With the aid of data mining techniques we may reduce the dimensionality of the dataset by extracting interpretable patterns which allow research questions to be addressed that would otherwise not be feasible (Romero et al, 2009).…”

Designing Like a Human: Simulating Cognitive Style in Teamwork with an Agent-Based Model

“…However, research on optimal team formation strategies is limited. Research on collaboration in team performance is often based on qualitative descriptions and small studies [28]. In vivo studies of design teams over long periods of time are expensive, and the results are often applicable only in a specific context [29].…”

Computational Psychometrics in Support of Collaborative Educational Assessments

“…Fortunately, there are other models such as stochastic point processes that have been used extensively in economics that can aid the modeling of interdependencies based on the temporal structure of the collaborative interactions (von Davier & Halpin, ), hidden Markov models (see Soller & Stevens, ), and models rooted in the cognitive or social theories such as agent‐based modeling, ACT‐R (Bergner, Andrews, Zhu, & Kitchen, ) and Markov decision processes, which is a cognitive model with separable components (goals/motivation, beliefs about the world, ability to optimize behavior) and which defines behavior as an optimization of expected rewards based on current beliefs about the world (LaMar, ).…”