Digital libraries (DLs) are new and innovative information systems, under constant development and change, and therefore evaluation is of critical importance to ensure not only their correct evolution but also their acceptance by the user and application communities. The Evaluation activity of the DELOS Network of Excellence has performed a large-scale survey of current DL evaluation activities. This study has resulted in a description of the state of the art in the field, which is presented in this paper. The paper also proposes a new framework for the evaluation of DLs, as well as for recording, describing and analyzing the related research field. The framework includes a methodology for the classification of current evaluation procedures. The objective is to provide a set of flexible and adaptable guidelines for DL evaluation

No abstract

Digital libraries, e-journal platforms, portals, e-prints and other web-based information systems provide services supporting users to perform intense work tasks that require complex interaction activities. The main components of such services are the users, the offered content and the system on which they are performed. This paper presents a model, which analyses the attributes of the electronic information services' components that affect user interaction and correlates them in the usefulness and usability evaluation process. An experimental study traces the relations between usefulness and usability, indicating that these evaluation parameters are interconnected and users do not find discriminating differences between them. The analysis of the content and system attributes suggests that user interaction is affected equally by content and system characteristics. Finally, the study illustrates users' preference for the attributes that constitute a useful system in contrast to those that support usability.

No abstract