Research on Evaluation System of User Experience With Online Live Course Platform

Abstract

While the COIVD-19 has triggered the rapid and large-scale promotion of online courses, it has also exposed the problem of poor user experience on online course platforms. Therefore, this research hopes to propose a complete user experience evaluation system to clarify the deficiencies of the platform and give directions for improvement. This research combines qualitative and quantitative, from the perspective of user experience, integrates data obtained through literature research, interview and network research to determine evaluation indices. The Delphi method and analytic hierarchy process are used to determine the weights of various indices and set the scoring level. It is obtained that the "ease of operation" has the most important impact on the user experience of the online live course platform. Innovatively adopting the t-test method to establish a comparative analysis method for the model application, a standardized process of model application is designed, and a complete evaluation system is constructed. Two pieces of software are selected as experimental samples to verify the model from both statistics and practical applications. The test results show that although the two experimental sample software have significant differences in the scores of multiple second-level indices, the overall scores are still similar, which is consistent with the direct evaluation results. Therefore, the user experience evaluation system proposed in this research is reliable, which can provide a reference for the construction of online live course platform and the optimization of user experience. INDEX TERMS User experience, evaluation index, analytic hierarchy process, online live course platform.

A Novel Integration Method for D Numbers Based on Horizontal Comparison

“…In this section, we will put forward the method of D numbers integration that is adopted to make an assessment of user experience of the online live course platform, and account for the rationality of the proposed method by data collection based on the evaluation index system in the literature [32].…”

“…However, due to the original design purpose and the characteristics of the software, the software cannot fully meet the needs of schools in online live courses. In this case, it is prominently significant to optimize the user experience of the online live course platforms [32].…”

“…In Wang et al [32], qualitative and quantitative methods were combined to establish evaluation indicators by integrating data obtained through the literature research, interviews and network research from the perspective of user experience. Delphi method and analytic hierarchy process were utilized to establish the weight of each indicator and set the scoring grade.…”

“…However, there is an important issue that has not been well resolved in [32]: when evaluating different platforms, some experts may not give definite scores as they are not familiar with the scoring items. In this case, the scores made reluctantly may greatly affect the final evaluation results.…”

“…In Wang et al [32], the main factors affecting the user experience of the online live course platforms are divided into four primary indicators, which are respectively Ease o Operation, Functional Completeness, Interface Rationality, Technical Reliability. Each pri mary indicator is divided into several secondary indicators.…”