Multidimensional assessment of technology and innovation programs: the impact evaluation of INCAGRO-Peru

Abstract

This article presents a methodological proposal and an empirical validation for the assessment of ST&I programs, particularly for choosing indicators and metrics from a multidimensional perspective. Its key feature is the construction of indicators designed to apprehend the wide array of characteristics displayed by the many different types of innovation program. Thus it combines deductive procedures (decomposition of goals) and inductive procedures (discussion with the players involved) with evaluation results and impacts in specific dimensions linked to the nature of a given program. We illustrate the approach using a World Bank Program called INCAGRO. The proposed method is a contribution to systematizing the definition of indicators and metrics for the assessment of ST&I programs. It helps define 'what should be evaluated' in a given program. Many different (unforeseen) results and impacts can emerge simultaneously with the main subject of the program. Thus multidimensional issues and multiple actors should be considered in the impact evaluation process.

Can Latin America Move Forward after a Lost Decade in Technical Change?: Looking at Opportunities for Knowledge-based Change in Times of Increasing Uncertainty

“…It is our understanding that research should look at how industry in distributed, and how production is done across countries and regions, and how capabilities are being used in different countries and regions. In fact, this framework is leading to several research programs in centers and universities around the world, including the "Production in the Innovation Economy" project at the MIT (Berger, 2013;Locke and Wellhausen, 2014), and leading to a significant body of research in Brazil on industrialization, namely through regulation and local content policies (Apolinário e Silva, 2011;Cassiolato et al, 2008;Salles-Filho et al, 2010).…”

Avaliação de redes de instituições de pesquisa científica e tecnológica baseada em um sistema de gestão padronizado

“…As in Salles-Filho et al (2010), that show a study about impact evaluation in innovation programs. Bin et al (2003) and Paulino et al (2007) study technological programs evaluation for environmental impact.…”

Multidimensional evaluation of a program for early-career researcher in Brazil - the Young Investigator in Emerging Centers program

“…To design the instruments for indicators collection, the Multidimensional Decomposition Method was used [4,5], enabling the program objectives to be decomposed into themes, indicators and metrics for the purposes of evaluation. Figure 1 shows the flow of activities comprised in the decomposition method.…”