How to Evaluate Competencies in Game-Based Learning Systems Automatically?

Thomas, Pradeepa; Labat, Jean-Marc; Muratet, Mathieu; Yessad, Amel

doi:10.1007/978-3-642-30950-2_22

Cited by 21 publications

(8 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Five of the studies evaluated the accuracy of the assessment system. P. Thomas, Labat, Muratet, and Yessad (2012) carried out a quantitative experiment comparing their diagnostic tool with an online questionnaire. A group of 15 students were asked to play a game on their own for about an hour.…”

Section: Empirical Evidencementioning

confidence: 99%

Specification and evaluation of an assessment engine for educational games: Integrating learning analytics and providing an assessment authoring tool

Chaudy

Connolly

2019

Entertainment Computing

View full text Add to dashboard Cite

Educational games are highly engaging, motivating and they offer many advantages as a supplementary tool for education. However, the development of educational games is very complex, essentially because of its multidisciplinary aspect. Fully integrating assessment is challenging and the games created are too often distributed as blackboxes; unmodifiable by the teachers and not providing much insight about the gameplays. We propose an assessment engine, EngAGe, to overcome these issues. EngAGe is used by both developers and educators. It is designed to separate game and assessment. Developers use it to easily integrate assessment into educational games and teachers can then modify the assessment and visualise learning analytics via an online interface. This paper focuses on EngAGe's benefits for games developers. It presents a quantitative evaluation carried out with 36 developers (7 experienced and 29 students). Findings were very positive: every feature of the engine was rated useful and EngAGe received a usability score of 64 using the System Usability Scale. A Mann-Whitney U test showed a significant difference in usability (Z=-3.34, p<0.002) between novice developers (mean=56) and experienced developers (mean=71) but none in terms of usefulness. This paper concludes that developers can use EngAGe effectively to integrate assessment and learning analytics in educational games.

show abstract

Section: Empirical Evidencementioning

confidence: 99%

Specification and evaluation of an assessment engine for educational games: Integrating learning analytics and providing an assessment authoring tool

Chaudy

Connolly

2019

Entertainment Computing

View full text Add to dashboard Cite

show abstract

“…Implicit technics: Consist on evaluating the learner while playing the game. This assessment approach could be developed based on different methods such as the conceptual framework Evidence-Centered Design (ECD) and Bayesian networks [19], Petri Network and ontology [20] or agent technology as proposed by the authors of the work [21] in "SIMFOR" serious game.…”

Section: Evaluation and Assessment Technics In Serious Gamesmentioning

confidence: 99%

Towards a New Generation of Intelligent Tutoring Systems

Beyyoudh

Idrissi

Bennani

2019

Int. J. Emerg. Technol. Learn.

View full text Add to dashboard Cite

In this paper, a new approach of intelligent tutoring systems based on adaptive workflows and serious games is proposed. The objective is to use workflows for learning and evaluation process in the activity-based learning context. We aim to implement a system that allow the coexistence of an intelligent tutor and a human tutor who could control and follow-up the execution of the learning processes and intervene in blocking situations. Serious games will be the pillar of the evalu-ation process. The purpose is to provide new summative evaluation methods that increase learner’s motivation and encourage them to learn.

show abstract

“…Others , such as [29], are focused on learning skills and motivation which are assessed using a probabilistic approach performed by the user. Their approach is based on adaptability in order to help learners to increase their [30] have as purpose to use petri nets extracted from the expert behavior in the game and compare the learner interactions to it using several diagnosis indicators. Tool that keep trace of the learners' activity in the shape of events in game and basing on these ones assesses the related performances respect to a predefined set of competences [25].…”

Section: Literature Reviewmentioning

confidence: 99%

Assessment-driven Learning through Serious Games: Guidance and Effective Outcomes

Yedri¹,

Aachak²,

Bouhorma³

2018

IJECE

View full text Add to dashboard Cite

<p>Evaluation in serious games is an important aspect; it aims to evaluate the good transmission of pedagogical objectives, the performance of student in relation to these objectives defined in the pedagogical scenario, the content of the course and the predefined criteria. However, the effectiveness of learning is under-studied due to the complexity involved to gamify the assessment concept, particularly when it comes to intangible measures related to the progression of learning outcomes, which is among the most important aspects of evaluation in serious games. This paper reviews the literature regarding assessment due to their importance in the learning process with a detailed assessment plan applied on serious game. Then, it presents a framework used to facilitate the assessment design integrated in serious games. Finally, a significant example of how the proposed framework proved successful with corresponding results will conclude the paper.</p>

show abstract

How to Evaluate Competencies in Game-Based Learning Systems Automatically?

Cited by 21 publications

References 10 publications

Specification and evaluation of an assessment engine for educational games: Integrating learning analytics and providing an assessment authoring tool

Specification and evaluation of an assessment engine for educational games: Integrating learning analytics and providing an assessment authoring tool

Towards a New Generation of Intelligent Tutoring Systems

Assessment-driven Learning through Serious Games: Guidance and Effective Outcomes

Contact Info

Product

Resources

About