IST Evaluation and Monitoring

Innovation in information society policy: rationale, policy mix and impact in The Netherlands

“…This is especially true for the mix of policies that influence innovation, directly or indirectly. In the context of R&D and innovation policy, the difficulties as well as the methods have been described by Fahrenkrog et al (2002), Ruegg and Feller (2003), Polt and Vonortas (2006) and OECD (2006). The focus of evaluation and impact toolboxes is on financial support for R&D. Increasingly, toolboxes and articles address the impact of ''soft'' elements of innovation policy, e.g.…”

Introduction to the handbook

“…These techniques may be used singly or in combination (mixed methods/ triangulation); they may entail collection of primary data or use of secondary data; they may be based on simple linear or complex, non-linear relationships; and they may be directed at one or more of the outputs, outcomes, and impacts associated with a program's objectives. Selection of the most appropriate methodologies, singly or in combination, will depend on the specific objectives and uses for which the evaluation is designed and the audiences for whom the evaluation is intended (Polt and Vonortas, 2006).…”

“…The choice of the mix of instruments, the sequence in which tools are deployed, and the ways in which elements derived from the different tools employed are merged in the overall analysis are central to the success of an evaluation (Georghiou and Laredo, 2006). Multiple techniques are combined to offset the limitations of specific approaches, to complement one another such that the findings generated by one approach (for example, surveys) are used as datasets in constructing variables used in other approaches (for example, econometric estimation), and to triangulate findings as a means of increasing the confidence that program impacts have been correctly identified and located (Polt and Vonortas, 2006).…”

“…A wide variety of methodologies exist to evaluate the objectives, pathways, outputs and outcomes. Mainstream evaluation techniques include surveys, statistical/econometric estimation, patent analysis, Polt and Vonortas (2006).…”