Abstract:CohViz is a feedback system that provides students with concept maps as feedback on the cohesion of their writing. Although previous studies demonstrated the effectiveness of Coh-Viz, the accuracy of CohViz remains unclear. Thus, we conducted two comprehensive validation studies to assess the accuracy of CohViz in terms of its reliability and validity. In a reliability study, we compared the concept maps generated by CohViz with concept maps generated by four human expert raters based on a text corpus comprisi… Show more
“…Redundant concepts (e.g., "group") were ignored (see also Boshuizen & Schmidt, 1992, for related approaches). CohViz showed a high precision in comparison to expert raters (ICC = .93, see Burkhart et al, 2019).…”
AcknowledgementWe would like to thank Eleonora Dolderer, Maike Köncke, and Anna Rosenträger for their assistance in conducting the study and rating the qualitative data. Moreover, we would like to thank Christian Burkhart and Zarah Weiß for providing us with the computer-based text difficulty measures. The research reported in this article was supported by the Federal Ministry of Education and Research in Germany (BMBF) under contract number 01JA1611.
“…Redundant concepts (e.g., "group") were ignored (see also Boshuizen & Schmidt, 1992, for related approaches). CohViz showed a high precision in comparison to expert raters (ICC = .93, see Burkhart et al, 2019).…”
AcknowledgementWe would like to thank Eleonora Dolderer, Maike Köncke, and Anna Rosenträger for their assistance in conducting the study and rating the qualitative data. Moreover, we would like to thank Christian Burkhart and Zarah Weiß for providing us with the computer-based text difficulty measures. The research reported in this article was supported by the Federal Ministry of Education and Research in Germany (BMBF) under contract number 01JA1611.
“…Whereas the cognitive tools developed by Ferrara and Butcher (2011) and Villalon and Calvo (2011) have not yet been comprehensively studied empirically, several experimental studies have been conducted on the concept-mapping feedback tool CohViz (Burkhart, Lachner, & Nückles, 2020;Lachner et al, 2017aLachner et al, , 2017bLachner, Backfisch, & Nückles, 2018;Lachner & Neuburg, 2019). CohViz provides students with automated visual feedback on the cohesion of their drafts (for details on the technical implementation, see the Method section of Study 1, and Lachner et al, 2017b).…”
Section: Cognitive Tool For Revision Support In Written Compositionmentioning
Writing cohesive texts is a crucial but challenging skill to master. Recently, cognitive tools that provide students with a graphical representation of their texts in the form of concept-maps have been shown to support students’ writing. Despite its beneficial effects, the addition of a graphical representation may have the disadvantage that students have to process multiple isolated representations (i.e., text, graphic), which may increase cognitive load. By applying principles of multimedia learning, in two experiments, we investigated whether interrepresentational signaling and spatial contiguity would have differential effects on students’ subsequent writing performance and on the processing of the graphical feedback. In Experiment 1, students wrote an expository text and either received conventional concept-map feedback, correspondence-enhanced concept-map feedback with interrepresentational signaling, spatially contiguous feedback, or no feedback during text revision. Regarding local cohesion, we found that students profited most when they received spatially contiguous feedback. Contrarily, correspondence-enhanced concept-map feedback was most effective for improving global cohesion. In Experiment 2, we examined the attentional processes while using correspondence-enhanced concept-map feedback versus conventional concept-map feedback by means of eye-tracking. Students receiving correspondence-enhanced concept-map feedback had longer fixation times on the concept-maps, more transitions between their text and the concept-map and were more efficient in improving their text for global cohesion than students receiving concept-maps without signaling. The findings suggest that interrepresentational signaling and spatial contiguity differentially contributed to students’ writing. Therefore, choosing the adequate format of instructional support plays a critical role in scaffolding students’ writing.
“…CohViz [21] is a feedback tool that demonstrates cohesion of written texts. It has been a popular tool to improve cohesion from a text passage, especially among students.…”
A Concept map is a pedagogical tool to help students understand the concepts and identify their misconceptions. Grading a concept map is a time-consuming manual task causing a severe bottleneck to use concept maps in a large class effectively. This paper presents Cronus that provides useful feedback on a student concept map similar to manual assessment by comparing it with an instructor concept map. The feedback includes identifying misconceptions, finding concepts, links, and branches that are (partially) matched or missed from a student concept map, generating summary statistics based on the feedback, and suggesting a grade of the map using predefined criteria (by the instructor) on the summary stats. Cronus is evaluated on a dataset of 74 student concept maps collected as homework assignments in an undergraduate (senior-level) course on introductory computer security. The evaluation results show that Cronus can provide accurate feedback on student concept maps compared to the manual evaluation of the maps and automatically suggest their correct grades.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.