Observational Scaffolding for Learning Analytics: A Methodological Proposal

Rodríguez‐Medina, Jairo; Rodríguez‐Triana, María Jesús; Eradze, Maka; Sastre, Sara García

doi:10.1007/978-3-319-98572-5_58

Cited by 3 publications

(2 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…While digital traces could be easily collectable through automatic means, higher-level interactions taking place in the physical space may be more challenging to detect and record in the computational format. Thus, observers can contribute to sense-making, especially when data comes totally or partially from physical spaces [33].…”

Section: Making Sense Of Learning Analytics: Context and Design-aware...mentioning

confidence: 99%

Contextualising Learning Analytics with Classroom Observations: A Case study

Eradze¹,

Rodríguez‐Triana²,

Milikic³

et al. 2020

IxD&A

Self Cite

View full text Add to dashboard Cite

Educational processes take place in physical and digital places. To analyse educational processes, Learning Analytics (LA) enable data collection from the digital learning context. At the same time, to gain more insights, the LA data can be complemented with the data coming from physical spaces enabling Multimodal Learning Analytics (MMLA). To interpret this data, theoretical grounding or contextual information is needed. Learning designs (LDs) can be used for contextualisation, however, in authentic scenarios the availability of machine-readable LD is scarce. We argue that Classroom Observations (COs), traditionally used to understand educational processes taking place in physical space, can provide the missing context and complement the data from the co-located classrooms. This paper reports on a co-design case study from an authentic scenario that used CO to make sense of the digital traces. In this paper we posit that the development of MMLA approaches can benefit from co-design methodologies; through the involvement of the end-users (project managers) in the loop, we illustrate how these data sources can be systematically integrated and analysed to better understand the use of digital resources. Results indicate that CO can drive sense-making of LA data where predefined LD is not available. Furthermore, CO can support layered contextualisation depending on research design, rigour and systematic documentation/data collection efforts.Also, co-designing the MMLA solution with the end-users proved to be a useful approach.

show abstract

Section: Making Sense Of Learning Analytics: Context and Design-aware...mentioning

confidence: 99%

Contextualising Learning Analytics with Classroom Observations: A Case study

Eradze¹,

Rodríguez‐Triana²,

Milikic³

et al. 2020

IxD&A

Self Cite

View full text Add to dashboard Cite

show abstract

“…In all cases, external human observers were in charge of the data collection and coding-twice in combination with automated LA solutions (in this case, a proposal to involve LA solutions) [45,46]-with both teachers and students as the common data objects (22 papers). Although the definition of the unit of analysis is an important methodological decision in observational studies or research in general [35,[67][68][69] we only found an explicit reference to it in one paper [66]. Nevertheless, looking at the description of the research methodology, we can infer that most of the studies focused on events (directed at interaction and behavioural analysis) (14) and activities (10).…”

Section: Rq1-what Is the Nature Of The Observations?mentioning

confidence: 99%

A Conversation between Learning Design and Classroom Observations: A Systematic Literature Review

2019

Self Cite

View full text Add to dashboard Cite

Learning Design, as a field of research, provides practitioners with guidelines towards more effective teaching and learning. In parallel, observational methods (manual or automated) have been used in the classroom to reflect on and refine teaching and learning, often in combination with other data sources (such as surveys and interviews). Despite the fact that both Learning Design and classroom observation aim to support teaching and learning practices (respectively a priori or a posteriori), they are not often aligned. To better understand the potential synergies between these two strategies, this paper reports on a systematic literature review based on 24 works that connect learning design and classroom observations. The review analyses the purposes of the studies, the stakeholders involved, the methodological aspects of the studies, and how design and observations are connected. This review reveals the need for computer-interpretable documented designs; the lack of reported systematic approaches and technological support to connect the (multimodal) observations with the corresponding learning designs; and, the predominance of human-mediated observations of the physical space, whose applicability and scalability are limited by the human resources available. The adoption of ICT tools to support the design process would contribute to extracting the context of the observations and the pedagogical framework for the analysis. Moreover, extending the traditional manual observations with Multimodal Learning Analytic techniques, would not only reduce the observation burden but also support the systematic data collection, integration, and analysis, especially in semi-structured and structured studies.

show abstract