Evaluating hypermedia and learning

Abstract

The Perseus Project has developed a hypermedia corpus of materials related to the ancient Greek world. The materials include a variety of texts and images, and tools for using these materials and navigating the system. Results from a three-year evaluation of Perseus use in a variety of college settings are described. The evaluation assessed both this particular sy,tem and the application of the technological genre to information management and to learning. The evaluation used a variety of methods to address questions about learning and teaching with hypermedia and to guide the development of early versions of the system. Results illustrate that such environments offer potential for accelerating learning and for supporting new types of learning and teachinG that students and instructors must develop new strategies for learning and teaching with such technology; and that institutions must develop infrastructural support for such technology. The results also illustrate the importance of well-designed interfaces and different types of assignments on user performance.

Methods for Evaluating Interactive Information Retrieval Systems with Users

“…These end products, in turn, are studied along with the subject's interactions with the system. Example studies that have used such methods include Egan et al [83], Halttunen and Järvelin [116], Kelly et al [166], Marchionini and Crane [192] and Vakkari [280].…”

“…This is not technically a self-report measure, but such assessments are usually generated by experts or other subjects who use standardized instruments to make assessments. As noted earlier, example studies that have attempted to assess final products include Egan et al [83], Kelly et al [166], Marchionini and Crane [192] and Vakkari [280].…”

First Steps to Netviz Nirvana: Evaluating Social Network Analysis with NodeXL

“…Just as exploratory efforts in scientific inquiry can be mapped to a cycle of sense-making tasks with feedback at each level [21], exploratory learning is a cycle of sense-making tasks with multiple feedback loops [11]. An early example of the MILCs paradigm in educational contexts is detailed in [22]. Of note, its non-structured observation format empowered students to explore, and in many cases reach new insights ("discovery learning," [22]).…”

“…An early example of the MILCs paradigm in educational contexts is detailed in [22]. Of note, its non-structured observation format empowered students to explore, and in many cases reach new insights ("discovery learning," [22]). A main advantage of extending the MILCs approach to learning contexts is that it offers students the same evaluation and design affordances it holds for research with domain experts: the MILCs process reflects the real way students explore an interface as they are learning SNA concepts.…”

Impact-ED - A New Model of Digital Library Impact Evaluation

“…They decided there were five important points to take into account when evaluating an open-ended developmental project such as eLib with a wide range of stakeholders (Kellerher et aI1996 (2000) and Borgman (2003) place on the user community and their approach to formative evaluation where evaluation is an integral part of digital library design and development (Borgman et al 2000;Marchionini & Crane 1999).…”