ASIRPA: A comprehensive theory-based approach to assessing the societal impacts of a research organization

Joly, Pierre; Gaunand, Ariane; Colinet, Laurence; Larédo, Philippe; Lemarié, Stéphane; Matt, Mireille

doi:10.1093/reseval/rvv015

Cited by 113 publications

(85 citation statements)

References 52 publications

(69 reference statements)

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Increasingly, development agencies, governments and donors assess the impact of agricultural research and innovation by the extent to which outputs and outcomes in the form of novel technologies and practices can lead to wider benefits (Joly et al 2015). This is often referred to as a process of 'scaling' to achieve 'impact at scale' (e.g.…”

Section: Introductionmentioning

confidence: 99%

Systemic perspectives on scaling agricultural innovations. A review

Wigboldus

Klerkx

Leeuwis

et al. 2016

Agron. Sustain. Dev.

243

181

View full text Add to dashboard Cite

Agricultural production involves the scaling of agricultural innovations such as disease-resistant and droughttolerant maize varieties, zero-tillage techniques, permaculture cultivation practices based on perennial crops and automated milking systems. Scaling agricultural innovations should take into account complex interactions between biophysical, social, economic and institutional factors. Actual methods of scaling are rather empirical and based on the premise of 'find out what works in one place and do more of the same, in another place'. These methods thus do not sufficiently take into account complex realities beyond the concepts of innovation transfer, dissemination, diffusion and adoption. As a consequence, scaling initiatives often do not produce the desired effect. They may produce undesirable effects in the form of negative spill-overs or unanticipated side effects such as environmental degradation, bad labour conditions of farm workers and loss of control of farming communities over access to genetic resources. Therefore, here, we conceptualise scaling processes as an integral part of a systemic approach to innovation, to anticipate on the possible consequences of scaling efforts. We propose a method that connects the heuristic framework of the multi-level perspective on socio-technical transitions (MLP) to a philosophical 'modal aspects' framework, with the objective of elucidating the connectedness between technologies, processes and practices. The resultant framework, the PRactice-Oriented Multi-level perspective on Innovation and Scaling (PROMIS), can inform research and policymakers on the complex dynamics involved in scaling. This is illustrated in relation to three cases in which the framework was applied: scaling agro-ecological practices in Nicaragua, farmer field schools on cocoa cultivation in Cameroon and 'green rubber' cultivation in Southwest China.

show abstract

Section: Introductionmentioning

confidence: 99%

Systemic perspectives on scaling agricultural innovations. A review

Wigboldus

Klerkx

Leeuwis

et al. 2016

Agron. Sustain. Dev.

243

181

View full text Add to dashboard Cite

show abstract

“…SNA can potentially answer the same objectives as those enounced in this paper to evaluate the impacts of research in the frame of approaches like ASIRPA (Evaluating Impact of Public Agricultural Research) (Joly et al, 2015) and IMPRESS (Impact of Research in the South) (Temple et al, 2016).…”

Section: Limitations and Generalization Of Snamentioning

confidence: 99%

Using social network analysis to evaluate the impacts of the research: on the transition to organic farming in the Camargue

2018

View full text Add to dashboard Cite

Évaluer les impacts des recherches en agriculture sur la société : outils, méthodes, études de cas. Abstract -This paper evaluates the relevance of undertaking a Social Network Analysis (SNA) to better understand the role played by the network of actors during innovation processes as well as validate stakeholders' views on actors' relationships in a case study on the transition to organic farming in the Camargue territory (South of France). The SNA method is part of a set of methods that forms an approach that was developed to evaluate ex-post the impacts of agronomic research in the framework of the European research project IMPRESA. The analysis particularly confirms, through the indicator of Betweenness, the growing role played by INRA (French National Institute of Agronomic Research) in the network and its contribution to the transition to organic agriculture. This is due in particular to closer relationships between farmers and INRA. The results also indicate a growing role played by CIRAD (Agricultural Research Center for International Development) through the lens of increased relationships with farmers. Additionally, the analysis confirms the great influence of the creation of the firm Biosud in 2003 on the transition to organic farming. SNA proved to be an excellent research tool for confirming stakeholders' statements about impact pathway, the events described in it, and the intensity of links between events. The reconstruction of the actor network over 5 different periods allows a significant deepening of the analysis. This method could be more largely used in evaluating impacts of research. Keywords: ex-post impact assessment / innovation / network analysis / information flow / riceRésumé -L'analyse du réseau social pour évaluer les impacts de la recherche : la transition vers l'agriculture biologique en Camargue. Cet article évalue la pertinence de réaliser une Analyse du réseau social (SNA) afin de mieux comprendre le rôle joué par le réseau d'acteurs au cours des processus d'innovation, ainsi que pour valider les dires des parties prenantes sur les relations entre acteurs dans un cas d'étude sur la transition vers l'agriculture biologique en Camargue (sud de la France). La méthode SNA fait partie d'un ensemble de méthodes formant une approche qui a été développée pour l'évaluation ex-post des impacts de la recherche agronomique dans le cadre du projet de recherche européen IMPRESA. L'analyse confirme en particulier, à travers l'indicateur de Betweenness (intermédiarité), le rôle grandissant joué par l'INRA (Institut national de la recherche agronomique) sur le réseau et sa contribution à la transition vers l'agriculture biologique. Ceci est la conséquence en particulier de relations plus étroites entre les agriculteurs et l'INRA. Les résultats indiquent également un rôle plus important joué par le Cirad (Centre de coopération internationale en recherche agronomique pour le développement) par le biais de relations renforcées avec les agriculteurs. De plus, l'analyse confirme l'influence importante ...

show abstract

“…We follow up on claims that changes in research evaluation are necessary to facilitate a change towards more interdisciplinary, application-oriented or responsible science (Hemlin and Rasmussen 2006;Wissema 2009). A range of approaches have been developed that address societal impact or relevance of scientific research (see for instance Spaapen and Van Drooge 2011;Joly et al 2015). But evaluation of TDC's requires more substantial changes.…”

Section: Effects On the Evaluation Of Research And Innovationmentioning

confidence: 99%

Evaluation and monitoring of transdisciplinary collaborations

Drooge

Spaapen

2017

J Technol Transf

View full text Add to dashboard Cite

In this paper we focus on the governance, in particular evaluation and monitoring, of the growing number of transdisciplinary collaborations (TDC's). Researchers and a variety of stakeholders collaborate in such TDC's, the purpose of which is to address societal challenges, like renewable energy, healthy aging or better language teaching in schools. Commonly used practices for evaluation of scientific research (accountability, rankings and benchmarking, dedicated to scientific excellence) do not fit the goals of TDC's. A bottom up or stakeholder oriented approach is better suited; one that stimulates mutual learning as well as the development of socially robust knowledge. We introduce the participatory impact pathways analysis (PIPA), as a method that suits the requirements. It has been developed in the context of development research. Two crucial features are the involvement of stakeholders from the start, and the joint development of a theory of change. This narrates what one wants to achieve and how that will be achieved. From this, stakeholders construct a logical frame that serves as a source for indicators. These indicators enable monitoring ex durante, during the TDC. We present evidence of the use of PIPA for a TDC. From this empirical evidence a number of issues with regard to evaluation, monitoring and indicators can be identified that require attention. Most prominent is the change of function of indicators. Instead of looking back and a focus on past performance, indicators look forward, in the short, intermediate and more distant future.

show abstract

ASIRPA: A comprehensive theory-based approach to assessing the societal impacts of a research organization

Cited by 113 publications

References 52 publications

Systemic perspectives on scaling agricultural innovations. A review

Systemic perspectives on scaling agricultural innovations. A review

Using social network analysis to evaluate the impacts of the research: on the transition to organic farming in the Camargue

Evaluation and monitoring of transdisciplinary collaborations

Contact Info

Product

Resources

About