Beyond the “Toolkit Approach”: Arts Impact Evaluation Research and the Realities of Cultural Policy‐Making

Abstract

This article presents a reflection on the possibility and potential advantages of the development of a humanities-based approach to assessing the impact of the arts, which attempts to move away from a paradigm of evaluation based on a one-size-fits-all model usually reliant on empirical methodologies borrowed from the social sciences. A "toolkit approach" to arts impact assessment, as the article argues, demands excessive simplifications, and its popularity is linked to its perceived advocacy potential rather than to any demonstrable contribution it may make to a genuine understanding of the nature and potential effects of artistic engagement. The article also explores the relationship between research, advocacy and the actual realities of policy-making with a view to proposing a critical research agenda for impact evaluation based on Carol Weiss's notion of the "enlightenment" function of policy-oriented research. In particular, the article attempts to highlight the contribution that cultural policy scholars working within the humanities could make to this area of policy research.

Humanities in the Twenty-First Century

“…Poignantly, the recommendations of the Finch Report were taken up by the Research Councils UK, and were adopted in their revised open-access policy, which was announced merely weeks after the publication of the Finch Report. 15 However, the difficulty in establishing and evidencing a link between research and policy is well documented, and the task is even more complex where the policy influence of humanities research is concerned (Belfiore and Bennett 2010). Thus, a whole host of new and problematic questions arise: What are the consequences of the fact that academia is no longer the sole locus for the production of research?…”

Lifelong learning in public libraries in 12 European Union countries: issues in monitoring and evaluation

“…It explores the role evaluation has played in these 12 countries in supporting their public libraries' efforts to deliver lifelong learning activities. The paper will shift the focus away from the well rehearsed debate about the instrumental value of libraries and the methodological challenges of capturing impact of cultural activities (Belfiore and Bennett 2010). Instead, it explores the administrative and policy implementation dynamics shaping evaluation processes.…”

Cultural policy research in the real world: curating “impact”, facilitating “enlightenment”

“…Intellectually then, the article is located in that interdisciplinary area of investigation that focuses on 'research utilization', to use the phrase commonly employed in the 1970s, when this work started to gain prominence, especially in the US (Belfiore and Bennett 2010). As the 'impact agenda' has risen internationally, this once highly specialized field of scholarship has acquired a wider significance, and much energy has gone into defining what impact 'is' and how to achieve it.…”