Evaluability Assessment: From Theory to Practice in the Department of Health and Human Services

Strosberg, Martin A.; Wholey, Joseph S.

doi:10.2307/975301

Cited by 10 publications

(6 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Early dissemination planning increases the likelihood that successful programs will be maintained. A number of the challenges can be identified early on by planning for dissemination through exploratory evaluation [42,43].…”

Section: Discussionmentioning

confidence: 99%

Contextual factors influencing readiness for dissemination of obesity prevention programs and policies

Dreisinger

Boland

Filler

et al. 2011

Health Education Research

View full text Add to dashboard Cite

Within the realm of obesity prevention research, there have been many promising interventions to improve physical activity and nutrition among diverse target populations. However, very little information is known about the dissemination and replication of these interventions. In 2007 and 2008 as part of a larger obesity prevention initiative, Missouri Foundation for Health funded 19 community-based programs throughout the state that showed promise of being model practices and committed to promoting their dissemination. Semi-structured key informant interviews were conducted with 64 individuals across the grant sites to help stage their readiness for dissemination. Through these interviews, the project team was able to identify the variables that impact a program's readiness for widespread distribution. Some factors contributing to readiness include: strong intervention planning and an existing sustainability plan; physical space available for the intervention; staff and monetary resources; administrative buy-in; community buy-in and engagement; a strong partner base and an agency with a healthy and active mission. These findings add to the literature by systematically identifying a set of key contextual variables. The qualitative data collected support a proposed framework and helps to establish a process for maintaining successful interventions based on several important factors that impact dissemination.

show abstract

Section: Discussionmentioning

confidence: 99%

Contextual factors influencing readiness for dissemination of obesity prevention programs and policies

Dreisinger

Boland

Filler

et al. 2011

Health Education Research

View full text Add to dashboard Cite

show abstract

“…Poor evaluation approaches and ultimately, disappointing results, were thought to be the result of inadequate program definition and lack of development and specification of causal links between intervention actions and expected results. In response, a “pre-assessment of evaluability” was developed to improve evaluation methodology, not by assessing whether a program can be evaluated, “but [by] whether the program is ready to be managed to achieve desired performance and outcomes, what changes are needed to allow results-oriented management, and whether evaluation is likely to contribute to improved program performance” [14]. Evaluability assessment has been revived in recent years, because the demand for evidence-based practice of has increased [15].…”

Section: Introductionmentioning

confidence: 99%

Identification of Complex Health Interventions Suitable for Evaluation: Development and Validation of the 8-Step Scoping Framework

2019

View full text Add to dashboard Cite

BackgroundThere is extensive literature on the methodology of evaluation research and the development and evaluation of complex interventions but little guidance on the formative stages before evaluation and how to work with partner organizations that wish to have their provision evaluated. It is important to be able to identify suitable projects for evaluation from a range of provision and describe the steps required, often with academic institutions working in partnership with external organizations, in order to set up an evaluation. However, research evaluating programs or interventions rarely discusses these stages.ObjectiveThis study aimed to extend work on evaluability assessment and pre-evaluation planning by proposing an 8-Step Scoping Framework to enable the appraisal of multiple programs in order to identify interventions suitable for evaluation. We aimed to add to the literature on evaluability assessment and more recent evaluation guidance by describing the processes involved in working with partner organizations.MethodsThis paper documents the steps required to identify multiple complex interventions suitable for process and outcome evaluation. The steps were developed using an iterative approach by working alongside staff in a local government organization, to build an evidence base to demonstrate which interventions improve children’s outcomes. The process of identifying suitable programs for evaluation, thereby establishing the pre-evaluation steps, was tested using all Flying Start provision.ResultsThe 8-Step Scoping Framework was described using the example of the local government organization Flying Start to illustrate how each step contributes to finding projects suitable for process and outcome evaluation: (1) formulating overarching key questions that encompass all programs offered by an organization, (2) gaining an in-depth understanding of the work and provision of an organization and engaging staff, (3) completing a data template per project/program offered, (4) assessing the robustness/validity of data across all programs, (5) deciding on projects suitable for evaluation and those requiring additional data, (6) negotiating with chosen project leads, both within and outside the organization, (7) developing individual project evaluation protocols, and (8) applying for ethical approval from the university and partner organization.ConclusionsThis paper describes the processes involved in identifying suitable projects for evaluation. It adds to the existing literature on the assessment of specific programs suitable for evaluation and guidance for conducting evaluations by establishing the formative steps required to identify suitable programs from a range of provision. This scoping framework particularly relates to academic partners and organizations tasked with delivering evidence-based services designed to meet local needs. The steps identified have been described in the context of early years provision but can be applied to a range of community-based evaluations, or more generally, to cases...

show abstract

“…The intent is to "identify particular program components and specific goal/effects that meet the preconditions of evaluabilityW (p. 88). Strosberg and Wholey (1983) have identified eight questions that an evaluability assessment attempts to answer:…”

Section: Evaluability Assessment Was Developed By Wholey and The Progmentioning

confidence: 99%

Evaluating Training and Educational Programs: A Review of the Literature

Mattoon¹

1992

View full text Add to dashboard Cite

Evaluability Assessment: From Theory to Practice in the Department of Health and Human Services

Cited by 10 publications

References 3 publications

Contextual factors influencing readiness for dissemination of obesity prevention programs and policies

Contextual factors influencing readiness for dissemination of obesity prevention programs and policies

Identification of Complex Health Interventions Suitable for Evaluation: Development and Validation of the 8-Step Scoping Framework

Evaluating Training and Educational Programs: A Review of the Literature

Contact Info

Product

Resources

About