Context matters: measuring implementation climate among individuals and groups

Abstract

BackgroundIt has been noted that implementation climate is positively associated with implementation effectiveness. However, issues surrounding the measurement of implementation climate, or the extent to which organizational members perceive that innovation use is expected, supported and rewarded by their organization remain. Specifically, it is unclear whether implementation climate can be measured as a global construct, whether individual or group-referenced items should be used, and whether implementation climate can be assessed at the group or organizational level.MethodsThis research includes two cross-sectional studies with data collected via surveys at the individual level. The first study assessed the implementation climate perceptions of physicians participating in the National Cancer Institute’s (NCI) Community Clinical Oncology Program (CCOP), and the second study assessed the perceptions of children’s behavioral health clinicians implementing a treatment innovation. To address if implementation climate is a global construct, we used confirmatory factor analysis. To address how implementation climate should be measured and at what level, we followed a five-step framework outlined by van Mierlo and colleagues. This framework includes exploratory factor analysis and correlations to assess differences between individual and group-referenced items and intraclass correlations, interrater agreements, and exploratory factor analysis to determine if implementation climate can be assessed at the organizational level.ResultsThe confirmatory factor analysis demonstrated that implementation climate is a global construct consisting of items related to expectations, support and rewards. There are mixed results, however, as to whether implementation climate should be measured using individual or group-referenced items. In our first study, where physicians were geographically dispersed and practice independently, there were no differences based on the type of items used, and implementation climate was an individual level construct. However, in the second study, in which clinicians practice in a central location and interact more frequently, group-referenced items may be appropriate. In addition, implementation climate could be considered an organizational level construct.ConclusionsThe results are context-specific. Researchers should carefully consider the study setting when measuring implementation climate. In addition, more opportunities are needed to validate this measure and understand how well it predicts and explains implementation effectiveness.

A Quantitative Test of an Implementation Framework in 38 VA Residential PTSD Programs

“…In addition, some of the sub-constructs have a limited empirical base and/or some of the evidence for their influence comes from fields other than healthcare. It is also important to note that the Rogers-Greenhalgh’s framework was published almost 10 years ago and that there are over 61 other dissemination and implementation models in the literature (for review, see Tabak et al 2012) as well as other efforts in implementation measure development related to additional frameworks (e.g., Aarons et al 2014; Jacobs et al 2014; Shea et al 2014). The work presented here is also consistent with efforts conducted by the Society for Implementation Research Collaboration to develop measures that map on to implementation frameworks (http://www.seattleimplementation.org/sirc-projects/sirc-instrument-project/) as well as the Grid-Enabled Measures Database (http://cancercontrol.cancer.gov/brp/ gem.html) project.…”

Estudio de relaciones entre cultura, clima y fuerza de clima laboral en Ecuador

“…Sin embargo, para Dickson y Resick (2006), el clima laboral va a tener una variabilidad en la forma en que se percibe de trabajador en trabajador, y también en función de cómo cada situación afecta estas percepciones, derivado de la interrelación entre el trabajador con su entorno de trabajo. Cardona y Cruz (2014) describen la existencia de niveles relacionados con el clima, desde el clima individual o psicológico, al clima organizacional, incluyendo también al clima del grupo (Cardona y Cruz, 2014;Clissold, 2006;Chaudhary y Rangnekar, 2016;Hernández y Valencia, 2014;Jacobs et al, 2014;James et al, 2008). Esta variabilidad del clima está relacionada con su fortaleza e impacta directamente en la consistencia de los comportamientos organizacionales (Dickson y Resick, 2006).…”

Evaluation Protocol To Assess an Integrated Framework for the Implementation of the Childhood Obesity Research Demonstration Project at the California (CA-CORD) and Massachusetts (MA-CORD) Sites

“…In the 12-month survey, the ORIC will be replaced with measures of implementation climate tailored to reflect unique intervention activities being implemented in each delivery system setting. 67,71 The 12-month survey also includes Likert scale items regarding perceived utility of specific implementation resources and capacity-building activities provided to respondents over the last year (e.g., training sessions). Additional, quantitative data on environmental and policy changes will also be collected at both time points as part of the overall CORD evaluation.…”