The role of learning theory in multimodal learning analytics

Abstract

This study presents the outcomes of a semi‐systematic literature review on the role of learning theory in multimodal learning analytics (MMLA) research. Based on previous systematic literature reviews in MMLA and an additional new search, 35 MMLA works were identified that use theory. The results show that MMLA studies do not always discuss their findings within an established theoretical framework. Most of the theory‐driven MMLA studies are positioned in the cognitive and affective domains, and the three most frequently used theories are embodied cognition, cognitive load theory and control–value theory of achievement emotions. Often, the theories are only used to inform the study design, but there is a relationship between the most frequently used theories and the data modalities used to operationalize those theories. Although studies such as these are rare, the findings indicate that MMLA affordances can, indeed, lead to theoretical contributions to learning sciences. In this work, we discuss methods of accelerating theory‐driven MMLA research and how this acceleration can extend or even create new theoretical knowledge. Practitioner notesWhat is already known about this topic Multimodal learning analytics (MMLA) is an emerging field of research with inherent connections to advanced computational analyses of social phenomena. MMLA can help us monitor learning activity at the micro‐level and model cognitive, affective and social factors associated with learning using data from both physical and digital spaces. MMLA provide new opportunities to support students' learning. What this paper adds Some MMLA works use theory, but, overall, the role of theory is currently limited. The three theories dominating MMLA research are embodied cognition, control–value theory of achievement emotions and cognitive load theory. Most of the theory‐driven MMLA papers use theory ‘as is’ and do not consider the analytical and synthetic role of theory or aim to contribute to it. Implications for practice and/or policy If the ultimate goal of MMLA, and AI in Education in general, research is to understand and support human learning, these studies should be expected to align their findings (or not) with established relevant theories. MMLA research is mature enough to contribute to learning theory, and more research should aim to do so. MMLA researchers and practitioners, including technology designers, developers, educators and policy‐makers, can use this review as an overview of the current state of theory‐driven MMLA.

Teaching in Higher Education after COVID-19: Optimizing Faculty Time and Effort Using a Proposed Model

“…Our research has contributed to the literature on faculty time allocation [55,57,58]. We also hope that our research can add value to future studies in teaching methods [2,[12][13][14]31], learning theory [11,23,60,63], course assessment [18,62], and faculty motivation [8]. With the current changes in higher education, that is, expectations and delivery methods, a more scientific look at faculty curriculum decision-making is necessary.…”

“…However, defining, quantifying, and measuring faculty effectiveness is a challenge. Satisfactory performance by faculty now indicates the requirement for a multiplicity of capabilities because of the high demands on faculty time [44,60].…”

VOTAT in Action

“…This enables interpretations that are broader, meaningful, and more easily generalized. As we strive to decipher the cognitive processes and strategies of students, it becomes indispensable to root these analyses within expansive theoretical frameworks (Giannakos & Cukurova, 2023; Hahnel, Jung, & Goldhammer, 2023).…”

Optimising multimodal learning in higher education: a case study of a selected South African institution

“…Representing information through different modes, and/or using a combination of modes, can create multiple access points for, and experience of learning. Giannakos and Cukurova (2023) view MML as a blend of multiple modes of learning through different types of platforms such as online learning and contact learning. These modes are mostly pictures, videos, class recording with old fashion way of contact classes and textbooks with one goal of teaching concepts.…”