Evaluating the Changes in Knowledge and Attitudes of Digital Library Users

Madle, Gemma; Kostkova, Patty; Mani-Saada, Jane; Weinberg, Johannes

doi:10.1007/978-3-540-45175-4_4

Cited by 11 publications

(7 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Most radically, we could even ask whether use of a digital library actually increases knowledge. It is not clear what evidence exists that physical libraries increase users' knowledge, but the ambivalent findings of one study of digital libraries provide food for thought (Madle, Kostkova, Mani‐Saada, & Weinberg, 2003). If people with real‐world motivations use digital libraries to acquire knowledge upon which they need to act and, after doing so, they have less understanding of the facts than before they began, is there a fundamental problem with digital libraries, with the specific library design with which they interacted, or with the idea that more information contributes to better decision making?…”

Section: Social Impactsmentioning

confidence: 99%

Digital libraries

Bearman¹

2007

Annual Review Info Sci & Tec

View full text Add to dashboard Cite

show abstract

Section: Social Impactsmentioning

confidence: 99%

Digital libraries

Bearman¹

2007

Annual Review Info Sci & Tec

View full text Add to dashboard Cite

show abstract

“…However, measuring knowledge and attitude changes of digital library online users should not be performed by asking them to recall if the library has ever had an impact on their knowledge or their work, as has been the case for most previous digital library impact evaluations [17], but by actually measuring their specific knowledge and attitude changes at the point of use in real-time, using pre-and post-questionnaires. This approach has been piloted with a small digital library in the healthcare domain where library users were asked a series of questions before using the library and then asked the same questions after using the library, showing positive changes in knowledge and attitude [18,19].…”

Section: Knowledge and Attitudementioning

confidence: 99%

“…knowledge and attitudes, length of hospital stay, prescribing rates or patient satisfaction. These are approaches that have been mirrored in evaluations since the advent of digital libraries [18]. By contrast, one study did focus on the impact of performing Medline searches on actual outcomes to show that searches performed earlier in the patient's hospital stay were associated with lower costs, charges and length of stay than those whose searches were performed later [13].…”

mentioning

confidence: 99%

What impact do healthcare digital libraries have? An evaluation of national resource of infection control at the point of care using the Impact-ED framework

Kostkova

Madle

2012

Int J Digit Libr

Self Cite

View full text Add to dashboard Cite

Over the last decade billions of dollars' worth of investments have been directed into ICT solutions for healthcare. In particular, new evidence-based digital libraries and web portals designed to keep busy clinicians up to date with the latest evidence were created in the UK and US. While usability and performance of digital libraries were widely researched, evaluation of impact did not seem to be sufficiently addressed. This is of major concern for healthcare digital libraries as their success or failure has a direct impact on patients' health, clinical practice, government policies and funding initiatives. In order to fill this gap, we developed the Impact-ED evaluation framework measuring impact on four dimensions of digital libraries-content, community, services and technology. Applying a triangulation technique we analysed pre-and post-visit questionnaires to assess the clinical query or aim of the visit and subsequent satisfaction with each visit, mapped it against weblogs analysis for each session and triangulated with data from semi-structured interviews. In this paper, we present the complete description of the Impact-ED framework, a definition of the comparative Impact score and application of the framework to a real-world medical digital library, the National Resource of Infection Control (NRIC, http:// www.nric.org.uk), to evaluate its impact at the point of care and demonstrate the generalisability of this novel methodology. We analysed the data from a cohort of 53 users who completed the registration questionnaire, of which 32 completed pre-and post-visit questionnaires of which 72 sets were matched for analysis and five users out of these

show abstract

“…Web evaluations can involve many different research methods including weblog analysis and pre-and post-questionnaires to investigate learning and use of online resources [5][6][7].…”

Section: Introductionmentioning

confidence: 99%

User information seeking behaviour: Perceptions and reality. An evaluation of the WHO Labresources Internet portal

Madle

Berger

Cognat

et al. 2009

Informatics for Health and Social Care

Self Cite

View full text Add to dashboard Cite

Evaluation on Internet portals is a key component of any online resource development. Understanding user information seeking behaviour and user perceived behaviour is essential to obtain the full picture of user needs, online activities and draw lessons to improve the design of Internet portals to better meet user expectations. This article discusses the evaluation of a WHO Internet portal: the Labresources website. The evaluation investigates user satisfaction with the resource, usability, demographic information about users and how well they could complete specific tasks using the website and compared this with the actual online behaviour revealing a number of discrepancies. An online questionnaire was advertised on the Labresources website during the period 25 November 2005 to 20 February 2006. As the site caters to English and French speakers, the questionnaire was made available in both languages. It consisted of two sections - the first section required the participant to complete three tasks using the website whereas the second section tested user satisfaction, information needs and appropriateness of the content. Weblogs data were compared with the questionnaire results to compare user perceived and actual online behaviour. Twenty one respondents completed the online questionnaire from a total of 18 countries. This was out of a potential 60 website users among whom the questionnaire was promoted. In general, respondents were satisfied with the website layout and navigation. 61.9% of respondents listed WHO among their top 5 and a third listed the Labresources website. The number of sessions where users browse (146) the information resources is almost three times more than the number of users who search (52) the resources. Weblogs revealed most interesting results with differences between what users reported doing when completing tasks and how easy they perceived the tasks and what they actually did. Twelve respondents completed at least one task. Of the remaining nine respondents, three did visit the Labresources website from the link in the questionnaire but did not go on to complete the tasks. Only one of the twelve who completed a task reported it being difficult. Three of the respondents who didn't complete a task reported the tasks to be difficult but only one of these actually followed the link to begin the tasks in the questionnaire. This article described an evaluation study investigating user perceived and actual behaviour at the WHO Labresources Internet portal. Although the questionnaire results demonstrated general satisfaction with the resource, a combination of a weblog evaluation with the questionnaire revealed a clearer picture of the user perception of and satisfaction with the website compared to their actual activity when completing the set tasks.

show abstract

Evaluating the Changes in Knowledge and Attitudes of Digital Library Users

Cited by 11 publications

References 9 publications

Digital libraries

Digital libraries

What impact do healthcare digital libraries have? An evaluation of national resource of infection control at the point of care using the Impact-ED framework

User information seeking behaviour: Perceptions and reality. An evaluation of the WHO Labresources Internet portal

Contact Info

Product

Resources

About