Developing evaluation capacity in organizations is a complex and multifaceted task. This article outlines a framework for building evaluation capacity. The framework is based on four strategic methods for teaching evaluation: (a) using logic models for sound program planning, (b) providing one-on-one help, (c) facilitating small-team collaborative evaluations, and (d) conducting large-scale multisite evaluations. The article also reports the results of using the framework successfully with Extension 4-H field educators. 4-H educators who were trained using this method significantly increased their evaluation knowledge and skill and reported feeling more positively about evaluation. In addition, the results show that the 4-H organization as a whole has developed a more positive evaluation culture. This framework for teaching evaluation has potential value for all organizations interested in developing evaluation capacity in regional educators as well as developing a positive culture of evaluation within the organization.
In recent years there has been an increased emphasis on science learning in 4-H and other youth development programs. In an effort to increase science capacity in youth, it is easy to focus only on developing the concrete skills and knowledge that a trained scientist must possess. However, when science learning is presented in a youth-development setting, the context of the program also matters. This paper reports the development and testing of the Science Process Skills Inventory (SPSI) and its usefulness for measuring science inquiry skill development in youth development science programs. The results of the psychometric testing of the SPSI indicated the instrument is reliable and measures a cohesive construct called science process skills, as reflected in the 11 items that make up this group of skills. The 11 items themselves are based on the cycle of science inquiry, and represent the important steps of the complete inquiry process.
Understanding the impact of youth development programs has been an important topic since the programs first began, and the past 25 years in particular have witnessed considerable advances in the evaluation of youth development programs. This article presents a brief history of youth development program evaluation, considering how it has changed over the years. From there, three contemporary trends related to youth program evaluation are examined: 1) a new evaluation focus, which is the emphasis on evaluating program quality; 2) organizational structures related to effective program evaluation, primarily in the area of program evaluability and evaluation capacity building; and 3) an emerging evaluation approach, involving youth in evaluating the programs that affect them. The article concludes with a call for programs to attend carefully to program implementation quality.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.