Principles and practice in impact assessment for academic libraries

Abstract

Purpose This paper aims to examine the principles that underpin library assessment, methods used for impact and performance evaluation and how academic libraries should use the findings, and it discusses how value frameworks help. Design/methodology/approach This is a literature review covering aspects of value (value propositions, value co-creation), value frameworks (including the 2015 ACRL framework, Holbrook typology with worked example), data analytics and collaborative projects including LibQUAL+ initiatives and the use of balanced scorecard principles (including a values scorecard). Findings The use of data analytics in library assessment requires collaboration among library services to develop reliable data sets. Scorecards help ongoing impact and performance evaluation. Queries that arise may require a framework, or logic model, to formulate suitable questions and assemble evidence (qualitative and quantitative) to answer new questions about the value of library services. The perceived value framework of Holbrook’s typology, the values scorecard and the ACRL framework all support the deeper level of inquiry required. Research limitations/implications Includes examples of possible application of frameworks. Practical implications A value framework might help data analytic approaches in combining qualitative and quantitative data. Social implications Impact assessment may require assessing how value is co-created with library users in use of e-resources and open data. Originality/value The study contrasts the varying approaches to impact evaluation and library assessment in academic libraries, and it examines more in-depth value frameworks.

Understanding EBLIP at an Organizational Level: An Initial Maturity Model

“…A culture of evidence based practice within an organizational or workplace context requires a shared approach and requires all library staff (Hallam & Partridge, 2006;Urquhart, 2018). Library leadership in evidence based practice is also essential to achieving its aims.…”

“…Library leadership and a customer-centered organizational culture were two of the enablers that supported the development of evidence based practices in libraries (Hiller et al, 2008). Urquhart (2018) stressed that implementing a culture of assessment, or evidence based practice, requires all library staff, not just managers, to appreciate the importance of the qualitative and quantitative evidence that they gather and to understand how such evidence can help demonstrate the value of library services. Gillespie, Partridge, Bruce, and Howlett (2016) found that a shared organizational approach to evidence based practice, whether intentionally sought or not, guided and developed library services and collections, helped to build relationships with its clients, and ensured that services aligned with clients' needs through an attitude and culture of continuous improvement.…”

“…Library leaders need to be able to evaluate the evidence based practice within their library to address both the internal and external drivers. Looking more broadly at the literature on library assessment (a term often used synonymously with EBLIP), many libraries have adopted tools, such as balanced scorecards, values scorecards, performance indicator frameworks, benchmarking, frameworks, and typologies, to demonstrate their value and impact and to assess cultural change (Urquhart, 2018). Madsen and Hurst (2018) proposed a Library Assessment Success Model that places the library as an organization within the eco-system of higher education.…”

Applied and conceptual approaches to evidence-based practice in research and academic libraries

“…Library leadership and a customer-centred organisational culture were two of the enablers that supported the development of evidence-based practices in libraries (Hiller, Kyrillidou, & Self, 2008). A culture of evidencebased practice, requires all library staff, not just leaders, to appreciate the importance of the qualitative and quantitative evidence that they handle and to understand how such evidence can help demonstrate the value of library services (Urquhart, 2018). Shared organisational approaches to evidence-based practice, guide and develop library services and collections through an attitude and culture of continuous improvement (Gillespie et al, 2016).…”

Culture of assessment in academic libraries in Kuwait: investigating the current situation and future prospects

“…A synthesis of prior research findings revealed that the assessment methods most commonly used by libraries include surveys/questionnaires, focus group interviews, usability studies, transaction log analysis, process analysis/ improvement studies, facility studies and card sorting tests (Covey, 2002a, b;Wright and White, 2007). While these assessment tools are essential for assessing library services, none can measure the impact of libraries on students' learning outcomes, which is important to the administrators of educational institutions (Kyrillidou and Cook, 2008;Leonard, 1992;Oakleaf, 2012;Powell, 1992;Urquhart, 2018). To overcome this limitation, Wong and Webb (2011) approached library assessment differently.…”