Automatic evaluation of online learning interaction content using domain concepts

Abstract

Purpose Interaction content is created during online learning interaction for the exchanged information to convey experience and share knowledge. Prior studies have mainly focused on the quantity of online learning interaction content (OLIC) from the perspective of types or frequency, resulting in a limited analysis of the quality of OLIC. Domain concepts as the highest form of interaction are shown as entities or things that are particularly relevant to the educational domain of an online course. The purpose of this paper is to explore a new method to evaluate the quality of OLIC using domain concepts. Design/methodology/approach This paper proposes a novel approach to automatically evaluate the quality of OLIC regarding relevance, completeness and usefulness. A sample of OLIC corpus is classified and evaluated based on domain concepts and textual features. Findings Experimental results show that random forest classifiers not only outperform logistic regression and support vector machines but also their performance is improved by considering the quality dimensions of relevance and completeness. In addition, domain concepts contribute to improving the performance of evaluating OLIC. Research limitations/implications This paper adopts a limited sample to train the classification models. It has great benefits in monitoring students’ knowledge performance, supporting teachers’ decision-making and even enhancing the efficiency of school management. Originality/value This study extends the research of domain concepts in quality evaluation, especially in the online learning domain. It also has great potential for other domains.

Can Distance Education be Closer: A Training Program about Autism

“…The fact that the OSA process was planned within the framework of the Transactional Distance Theory may also have been effective in the realization of the "sharing" expectation. Comparing to face-to-face environments, the success of online environments providing time and space independence mediated flexible learning opportunities, directly related to interaction (Luo et al, 2017;Wu et al, 2020). Several online implementation studies have emphasized student-teacher, student-student and student-system interactions (Crawford-Ferre & Wiest, 2012;Meyer & McNeal, 2011;Moore, 1997;Parker, 2015).…”

The Construction of Online Education Quality Evaluation System Based on Intelligent Algorithm

“…Literature [19] describes the use of a visualization tool to collect data on students' learning effects and proof of learning to assess the effectiveness of teaching and facilitate teachers' adjustments to teaching methods and early interventions with students to promote the effective and stable development of teaching. Literature [20] outlines a new method for assessing the quality of interactive online learning content by utilizing the domain concept. A corpus sample is classified and evaluated based on domain concepts and text features.…”

The Research Trends of Text Classification Studies (2000–2020): A Bibliometric Analysis

“…In the field of authorship attribution, in addition to traditional unsupervised methods such as Burrows’ delta (Burrows, 2002), an increasing number of studies have employed machine learning based classification techniques and reported promising results (Ebrahimpour et al, 2013; Jockers et al, 2008; Posadasduran et al, 2017; Tsimboukakis & Tambouratzis, 2010). TC techniques are also important methods in knowledge management, such as content-based recommendation (Hawashin et al, 2019; Wijewickrema et al, 2019; Wu et al, 2020), patent classification (Kim et al, 2020), and information extraction (Al-Yahya, 2018). Besides, TC techniques have been frequently applied to the detection of unwanted messages, including short message spam, junk mails, and suspicious malignant mails (Ezpeleta et al, 2017; Hsiao & Chang, 2008; Mujtaba, Shuib, Raj, & Gunalan 2018; Seyyedi & Minaeibidgoli, 2018).…”