Evaluating co-creation of knowledge: from quality criteria and indicators to methods

Abstract

Abstract. Basic research in the natural sciences rests on a long tradition of evaluation. However, since the San Francisco Declaration on Research Assessment (DORA) came out in 2012, there has been intense discussion in the natural sciences, above all amongst researchers and funding agencies in the different fields of applied research and scientific service. This discussion was intensified when climate services and other fields, used to make users participate in research and development activities (co-creation), demanded new evaluation methods appropriate to this new research mode. This paper starts by describing a comprehensive and interdisciplinary literature overview of indicators to evaluate co-creation of knowledge, including the different fields of integrated knowledge production. Then the authors harmonize the different elements of evaluation from literature in an evaluation "cascade" that scales down from very general evaluation dimensions to tangible assessment methods. They describe evaluation indicators already being documented and include a mixture of different assessment methods for two exemplary criteria. It is shown what can be deduced from already existing methodology for climate services and envisaged how climate services can further to develop their specific evaluation method.

Climate Change Adaptation Tools at the Community Level: An Integrated Literature Review

“…Transdisciplinarity (TD) is an approach that involves different disciplines as well as scientific and non-scientific stakeholders collaborating to address socially relevant problems, through joint knowledge integration and mutual learning. The aim is to produce "socially robust knowledge" that is both scientifically valuable and relevant for societal progress [19][20][21][22][23]. However, the uptake of decision support tools by non-scientific stakeholders (local communities) is challenging due to many factors (including prohibitive financial cost, top-down design of the tools, poorly designed participation processes and technical complexity).…”

Human-Large Carnivores Co-existence in Europe – A Comparative Stakeholder Network Analysis

“…We analyze the project partners' current stakeholder networks (Phase 2a) as developed and depicted by network members themselves. We thereby follow the concept described by Schuck-Zöller et al (2017) which has users participate in research and development activities to actually co-create results. By choosing this transdisciplinary approach, we integrate actionable knowledge from science and topic-related stakeholders to address real-world problems (Johnson et al, 1993;Lang et al, 2012;Hartel et al, 2019).…”

El poder de la colaboración: evaluación de una nueva e innovadora prueba WeQ

“…La enseñanza y el aprendizaje, el aprendizaje mutuo, y el aprendizaje de intercambio, es decir, entre viejos y jóvenes, autónomos y profesionales, expertos interdisciplinarios se convierte entonces en un proceso de co-creatividad -un concepto genuinamente integrador iniciado por nosotros. Se creó una confluencia de todas las competencias y actuaciones de todos los que participan en el proceso (Hüther, 2017;Hüther et al, 2018;Lukesch & Petzold, 2011;Schuck-Zöller et al, 2017).…”