The use made of evaluation output is crucial for understanding the position and effectiveness of evaluation systems. This article examines the development of evaluation in the Italian university system from the 1990 s onwards where serious problems have been and continue to be addressed in the use of evaluation output to improve academic activities and make universities accountable for their behaviour. There is a tendency for evaluation to generate inappropriate or undesired effects and for those being assessed to adopt opportunistic behaviour. Underestimation of the universities' organisational features is the main reason for so many difficulties.
This article focuses on the impact of research and education evaluation on two universities: Trento State University (Italy) and the University of Amsterdam (The Netherlands). The article adopts a system approach to evaluation and proposes a model to describe and analyse evaluation systems. The analysis has been carried out by means of in-depth interviews with key decision-makers involved in the two universities. The analysis shows that many of the differences in impact can be linked to the different 'evaluation stages' the universities are currently in; the Italian university experiencing a number of novel effects, with the Dutch university reaping the benefits (and experiencing some problems) of having institutionalized evaluation practices.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.