Students’ Collaboration Patterns in a Productive Failure Setting: An Epistemic Network Analysis of Contrasting Cases

A Systematic Literature Review of Empirical Research on Epistemic Network Analysis in Education

“…The remaining articles ranged from a single coder to nine coders. The manual coding was supported with software tools in 19 articles (25%), for example, ncoder automatic coding [26], [45], [47], [49], [73], [82], MAXQDA 2018 [84], [90]- [92] and NVivo [67], [104], automated coding algorithm [48], [77], Python [44], and linguistic tools (LIWC and Coh-Metrix) [59].…”

“…The reliability was tested in 32 (42.1%) articles using Cohen's kappa. In addition, Shafer's rho statistic alongside the kappa test were reported in eight articles (10.5%) [26], [47]- [50], [73], [77], [82]. Other reliability tests were used less frequently, such as Krippendorff's test in two articles [97], [98] and Cronbach's alpha in one article [64].…”

“…All 76 reviewed articles included comparisons that can be grouped into one of eight categories (Figure 5). In 23 articles (30.3 %), the comparison was across levels of participants' performance, for example, high vs. low performers [19], [23], [25], [50], [74], [76], [86], student competency level [69], [102], quality of ideas [46], [73], learning outcomes [80], [83] , positive vs. negative gain [82], proficiency level [68], accuracy level [96] and correct graph solving [95].…”

“…[105] define collaborative learning as a "set of teaching and learning strategies promoting student collaboration in small groups in order to optimize their own and each other's learning". ENA was used to study students' collaboration with each other and their mentors to frame, examine, and solve complex problems in different settings, for example, collaborative problem-solving (CPS) [71], [73], [75] communities of inquiry [48], computer supportive collaborative learning (CSCL) [49], project-based engineering [19] and scientific reasoning processes [16].…”

Approaching Structured Debate with Quantitative Ethnography in Mind

“…Barany et al [8] analyzed student discussions and included "debate" as a type of interaction, but the authors were not specifically centered on investigating ways in which students formally engage in debate, nor did they explicitly deal with the structure of debate in general. Similarly, Nachtigall and Sung [9] utilize debate as a code to describe student interactions during collaboration, but do not delve into the components of that debate. Hamilton & Hobbs [10] considered political debates which would tend to be included as SD, but their analysis strayed from the pro/con focus and towards a more epistemic view of arguments and positions.…”