A Conceptual Framework for Using and Evaluating Web-Based Learning Resources in School Education

Abstract

Executive SummaryWeb-based learning resources (WBLRs) have provided teachers with a wide range of new teaching experiences that are not possible in traditional classroom. However, little research has been done as to which approach to WBLRs is suitable to address issues that are pertinent to learning. This paper proposes a conceptual framework to explore the design and evaluation of WBLRs in school education. The paper also examines the way in which the framework is used to evaluate students' and teachers' perceptions of WBLRs by means of survey questionnaires. Before developing the framework, a literature review is undertaken to report on the state of research in the field of WBLRs. The literature review reveals a lack of design and evaluation of WBLRs in educational settings. Then, the framework is developed in three steps. First, the concept of WBLR is defined as a learning object that exists at the intersection of content, pedagogy, and technology. Second, concepts of usability are analyzed, and a definition of technical and pedagogical usability is proposed. Technical usability is a self-evident requirement, but it is not sufficient for designing pedagogically usable WBLRs. The usability concept must be extended to capture issues that are fundamental to learning. Nevertheless, technical and pedagogical usability cannot be considered as separate, disjointed activities. Finally, the context of use and evaluation is specified. The context is the totality of relationships between students and surrounding elements within a teaching and learning situation. The WBLR can be considered as an element of the context, and as such, it becomes a source of learning, by means of interaction with the students. To investigate the value of the framework, a case study is undertaken in three classes. To this end, the framework was used to inform the study, and the findings of the study were mapped back onto the framework in order to identify additional features found in classroom settings and points in the conceptual framework that did not significantly impact the case study. The main factor that impacted the design and evaluation of WBLRs was the pedagogical usability. While students and teachers globally agreed about technical usability, the findings indicate that they differed in their perceptions of pedagogical usability. In addition, the conceptual framework and the findings of the case study differed to a certain degree regarding the connectedness of some pedagogical usability criteria.The findings also revealed the existence of cultural values connected to students' preferred choices. This factor has not been explicitly anticipated from the conceptual framework. The findings cannot be generalized due to the limited nature of the study. However, the article proposes elements of a future research work that should be taken forward to generate a more complete picture of usability isMaterial published as part of this publication, either on-line or in print, is copyrighted by the Informing Science Institute. Permission to make ...

Towards the Learning Experience Technology Usability Framework

“…(Hadjerrouit, 2010) Usability Heuristics for E-Learning Design (Mehlenbacher, Bennett, Bird, Ivey, Lucas, Morton, & Whitman, 2005) The Design Principles for Flow Experience in Educational Games (Kiili, Freitas, Arnabb & Lainema, 2012) Gameflow Model (Sweetser & Wyeth, 2005) Pedagogical playability heuristics (Tan, Goh, Ang & Huang, 2013) Events of instruction (Gagné, Wager, Golas, Keller, & Russell, 2005) Computer-Assisted Assessment (CAA) Heuristics (Sim & Read, 2015) Technological Pedagogical Content Knowledge: A Framework for Teacher Knowledge. (Mishra, & Koehler, 2006) Coding framework for design portion of international Learning solution Expert Evaluations (Table 1) and combining its features with knowledge gained from previous frameworks.…”

“…Also, some frameworks have addressed this by creating an evaluation framework for assessing the complete usability of learning technology without creating any artificial separation between the two important aspects of learning technology usability (e.g. Hadjerrouit, 2010).…”

Reaching all Through Open and Distance Learning in Tanzania

“…The ministry of education and vocational training and its educational agencies should establish a quality assurance unit, through which the educational curriculum developers will constitute the unit and have a role of monitoring and evaluating the quality of web based resources. However, there should be a routine of evaluating students' and teachers' perceptions of web based learning resources in open and distance education, modalities of teaching and learning using these resources (Hadjerrouit, 2010).…”

Examining Mathematical Task and Pedagogical Usability of Web Contents Authored by Prospective Mathematics Teachers

“…This was followed by a meeting and discussion on the appropriateness of the rubrics. Finally, the rubrics were derived after modifying rating criteria used by Nokelainen (2006) and Hadjerrouit (2010a) to assess pedagogical usability of digital learning tools. Ten attributes were deemed to reflect instructional value of web contents for the study.…”