Open data framework for sustainable assessment of project-based learning experiences

Abstract

Purpose In a project-based learning experience, the detailed monitoring of the activities in which team members participate can be useful to evaluate their work. However, the project activity produces a large amount of data that can be hardly assessed by a single project supervisor. This poses a scalability issue if the number of users or projects size increases. In this vein, the purpose of this paper is to make the assessment of online learning experiences more sustainable. Design/methodology/approach This paper describes a learning-oriented collaborative assessment method, supported by an open data framework. Also, an architecture for the extraction of different indicators to facilitate the assessment process is presented. Findings The assessment method and the open data framework were applied to a project-based course on web engineering. This experience has provided positive evidences because the grade measurement was backed up with assessment evidences and calculated with less effort. Research limitations/implications At the moment, results indicate that apparently there are no significant evidences against the sustainable evaluation practices for students’ summative evaluation. Nevertheless, when more data become available, a more statistically significant analysis could be made to determine the influence of the assessment practices in the final result of the evaluated skills. Originality/value In contrast to various existing proposals for e-assessment, the strategy focuses on assessing learning experiences in software development projects. Also, the approach is based on the reuse of information from external process supporting tools by integrating a number of metrics in a non-intrusive way.

A Systematic Literature Review of Student Assessment Framework in Software Engineering Courses

“…This systematic review aimed to examine frameworks or tools employed by educators for the identification of student competencies within software engineering courses. A total of twenty studies [39], [40], [49]- [58], [41]- [48], as previously mentioned, were identified. Among the studies reviewed, 55 percent (11 studies) were presented at conferences, while 45 percent (9) found their place in journals.…”

“…Evaluation of student performance in this competition hinged upon an assessment matrix. Similarly, Traverso-Ribon et al [40] engaged in project-based learning assessment via a webbased technique, also incorporating the use of an assessment matrix.…”

La tercera misión

“…Este primer número del volumen 17 incluye siete artículos regulares. El primero de ellos lleva por título "Evaluación sostenible de experiencias de aprendizaje basadas en proyectos" y ha sido realizado por Traverso-Ribón et al (2016). En este trabajo se describe una metodología de evaluación orientada al aprendizaje y un framework software de datos abiertos aplicable a la evaluación de proyectos de desarrollo colaborativo.…”

Métodos de evaluación de competencias en serious games: estudio y análisis sobre su estado actual - [Skill assessment methods in serious games: a state of the art study and analysis]

“…Para los estudiantes universitarios, estas tecnologías facilitan el acercamiento a la información y desarrollo de competencias tanto académicas como profesionales, lo cual proporciona una oportunidad para crear nuevos contextos de aprendizaje, más flexibles y personalizados (Traverso-Ribón et al, 2016). Entre estos nuevos contextos destaca especialmente el uso de los videojuegos, ya que de forma habitual se han asociado en exclusiva a entornos de ocio y entretenimiento.…”