A Preliminary Analysis of Software Engineering Metrics-based Criteria for the Evaluation of Learning Objects Reusability

Sanz, J.; Dodero, Juan Manuel; Sánchez‐Alonso, Salvador

doi:10.3991/ijet.v4s1.794

Cited by 11 publications

(7 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…A digital resource by itself may lack some of the features that facilitate its access, use and reuse. Therefore, a digital resource could be considered a learning object if it contains at least some of the following characteristics: educational and instructional design in its creation (Wiley, 2002); pedagogical components (Polsani, 2006); and metadata information achieving some degree of interoperability, accessibility and reusability between different systems (Friesen, 2009; Sanz et al , 2009). …”

Section: Resultsmentioning

confidence: 99%

See 1 more Smart Citation

Trends and challenges of visual search interfaces in digital libraries and repositories

Gaona-García

Martín-Moncunill

Herrera‐Viedma

2017

View full text Add to dashboard Cite

Purpose This paper aims to present an overview of the challenges encountered in integrating visual search interfaces into digital libraries and repositories. These challenges come in various forms, including information visualisation, the use of knowledge organisation systems and metadata quality. The main purpose of this study is the identification of criteria for the evaluation and integration of visual search interfaces, proposing guidelines and recommendations to improve information retrieval tasks with emphasis on the education-al context. Design/methodology/approach The information included in this study was collected based on a systematic literature review approach. The main information sources were explored in several digital libraries, including Science Direct, Scopus, ACM and IEEE, and include journal articles, conference proceedings, books, European project reports and deliverables and PhD theses published in an electronic format. A total of 142 studies comprised the review. Findings There are several issues that authors did not fully discuss in this literature review study; more specific, aspects associated with access of digital resources in digital libraries and repositories based on human computer interaction, i.e. usability and learnability of user interfaces; design of a suitable navigation method of search based on simple knowledge organisation schemes; and the use of usefulness of visual search interfaces to locate relevant resources. Research limitations/implications The main steps for carrying out a systematic review are drawn from health care; this methodology is not commonly used in fields such as digital libraries and repositories. The authors aimed to apply the fundamentals of the systematic literature review methodology considering the context of this study. Additionally, there are several aspects of accessibility that were not considered in the study, such as accessibility to content for disabled people as defined by ISO/IEC 40500:2012. Originality/value No other systematic literature reviews have been conducted in this field. The research presents an in-depth analysis of the criteria associated with searching and navigation methods based on the systematic literature review approach. The analysis is relevant for researchers in the field of digital library and repository creation in that it may direct them to considerations in designing and implementing visual search interfaces based on the use of information visualisation.

show abstract

Section: Resultsmentioning

confidence: 99%

“…metadata information achieving some degree of interoperability, accessibility and reusability between different systems (Friesen, 2009; Sanz et al , 2009).…”

Section: Resultsmentioning

confidence: 99%

Trends and challenges of visual search interfaces in digital libraries and repositories

Gaona-García

Martín-Moncunill

Herrera‐Viedma

2017

View full text Add to dashboard Cite

show abstract

“…Evaluation criteria for selection of visualization library. its creation [42]; ii) educational components for its use [43]; iii) a set of descriptions called metadata which help to achieve some degree of interoperability, accessibility and reusability between different systems [44,45].…”

Section: Analysis Of Search Criteriamentioning

confidence: 99%

Issues of Visual Search Methods in Digital Repositories

Gaona-García¹,

Montenegro-Marín²,

Gaona-García³

et al. 2018

IJIMAI

View full text Add to dashboard Cite

Repositories are important infrastructures which allow the dissemination of large collections of digital resources hosted in museums, libraries, academic institutions or specialized documentation centers. However, there are nowadays several limitations associated with irrelevant search results based on a knowledge area. Some studies have highlighted the major role of information visualization strategies based on Simple Knowledge Organization Systems (SKOS) so as to mitigate such difficulties. The main goal of this article is to present recommendations using information visualization based on SKOS for the development of navigational search interfaces in digital repositories focused on learning process. We use card sorting as methodology in order to obtain qualitative results in our study. As preliminary results we found that taxonomies in visual search engines improve the access to large collections of digital resources based on SKOS, but it depends on the design of taxonomy concepts defined in digital repositories. Finally, it is recommended that the creators of repositories focus their efforts on define levels of relationship and partnership between digital resources using knowledge representation structures like thesauri or ontologies; work with usable visualization interfaces like tree, radial or icicle; and link relevant metadata fields with the navigation structure.

show abstract

“…Background Some studies focus on evaluating aspects, or on metrics for determining the quality level of the learning object, for example, the levels of reusability, accessibility, usability and portability, among others. Sanz et al (2009) proposed to evaluate the reusability from a structural viewpoint, through the following features: self-contained, modular, properly grained, traceable, modifiable, usable and standardized. From a contextual viewpoint, a learning object which is more dependent and specific will be more limited in terms of its reusability.…”

Section: El 355 954mentioning

confidence: 99%

Towards a holistic model for quality of learning object repositories

Vidal‐Castro

Navarrete

Domínguez

et al. 2017

View full text Add to dashboard Cite

Purpose This paper aims to address the need to ensure the quality of metadata records describing learning resources. We propose improvements to a metadata-quality model, specifically for the compliance sub-feature of the functionality feature. Compliance is defined as adherence level of the learning object metadata content to the metadata standard used for its specification. The paper proposes metrics to assess the compliance, which are applied to a set of learning objects, showing their applicability and usefulness in activities related to resources management. Design/methodology/approach The methodology considers a first stage of metrics refinement to obtain the indicator of the sub-feature compliance. The next stage is the proposal evaluation, where it is determined if metrics can be used as a conformity indicator of learning object metadata with a standard (metadata compliance). The usefulness of this indicator in the information retrieval area is approached through an assessment of learning objects where the quality level of its metadata and the ranking in which they are retrieved by a repository are correlated. Findings This study confirmed that the best results for metrics of standardization, completeness, congruence, coherence, correctness and understandability, which determine the compliance indicator, were obtained for learning objects whose metadata were better labelled. Moreover, it was found that the learning objects with the highest level of compliance indicator have better positions in the ranking when a repository retrieves them through an exact search based on metadata. Research limitations/implications In this study, only a sub-feature of the quality model is detailed, specifically the compliance of learning object standard. Another limitation was the size of the learning objects set used in the experiment. Practical implications This proposal is independent from any metadata standard and can be applied to improve processes associated with the management of learning objects in a repository-like retrieval and recommendation. Originality/value The originality and value of this proposal are related to quality of learning object metadata considered from a holistic point of view through six metrics. These metrics quantify both technical and pedagogical aspects through automatic evaluation and supported by experts. In addition, the applicability of the indicator in recovery systems is shown, by example to be incorporated as an additional criterion in the learning object ranking.

show abstract

A Preliminary Analysis of Software Engineering Metrics-based Criteria for the Evaluation of Learning Objects Reusability

Cited by 11 publications

References 8 publications

Trends and challenges of visual search interfaces in digital libraries and repositories

Trends and challenges of visual search interfaces in digital libraries and repositories

Issues of Visual Search Methods in Digital Repositories

Towards a holistic model for quality of learning object repositories

Contact Info

Product

Resources

About