ObjectivesEvaluating an existing suite of health system performance (HSP) indicators for continued reporting using a systematic criteria-based assessment and national consensus conference.DesignModified Delphi approach with technical and leadership groups, an online survey of stakeholders and convening a national consensus conference.SettingA national health information steward, the Canadian Institute for Health Information (CIHI).ParticipantsA total of 73 participants, comprised 61 conference attendants/stakeholders from across Canada and 12 national health information steward staff.Primary and secondary outcome measuresIndicator dispositions of retention, additional stakeholder consultation, further redevelopment or retirement.Results4 dimensions (usability, importance, scientific soundness and feasibility) typically used to select measures for reporting were expanded to 18 criteria grouped under the 4 dimensions through a process of research and testing. Definitions for each criterion were developed and piloted. Once the definitions were established, 56 of CIHI's publicly reported HSP indicators were evaluated against the criteria using modified Delphi approaches. Of the 56 HSP indicators evaluated, 9 measures were ratified for retirement, 7 were identified for additional consultation and 3 for further research and development. A pre-Consensus Conference survey soliciting feedback from stakeholders on indicator recommendations received 48 responses (response rate of 79%).ConclusionsA systematic evaluation of HSP indicators informed the development of objective recommendations for continued reporting. The evaluation was a fruitful exercise to identify technical considerations for calculating indicators, furthering our understanding of how measures are used by stakeholders, as well as harmonising actions that could be taken to ensure relevancy, reduce indicator chaos and build consensus with stakeholders.
While Canada has a well-established tradition of transparency and accountability for health-system performance comparisons, few measures of outcomes are reported. In this Commentary, we examine what outcomes measurement is; the state of outcomes measurement in Canada; and offer recommendations so that the generation of better information on health system outcomes can help achieve greater value in the health sector. Outcome measures help to better understand how effectively the health system achieves its goals, support better decision-making by relating investment decisions to outcomes, and better match the delivery of health and social services to the evolving needs of populations and patients. From a research perspective, outcome measures help better understand how policy interventions and healthcare services can contribute to achieving targeted outcomes and their role in the broader social determinants of health. And from a democratic perspective, publicizing outcome measures can empower patients, families and communities to engage in the policy debate about which outcomes matter most and at what cost-and in the ways healthcare should be delivered. Among our key recommendations: • The federal and provincial governments should complement current data with outcome measures of relevance to patients, clinicians, system managers and policy practitioners. In particular, patient-reported outcome measures and patient reported experience measures should augment datasets currently available in pan-Canadian clinical registries. • Organizations with a mandate to report publicly on health-system performance, such as the Canadian Institute for Health information and provincial health quality councils, should collect outcomes data and report publicly on outcomes, filling current gaps in outcomes measurement and public reporting.
ObjectivesThis study examines palliative care (PC) coding practices since the introduction of a national coding standard and assesses a potential association with hospital standardised mortality ratio (HSMR) results.SettingAcute-care hospitals in Canada.Participants∼16 million hospital discharges recorded in Canadian Institute for Health Information (CIHI)'s Discharge Abstract Database from April 2006 to March 2013.Primary and secondary outcome measuresIn-hospital mortality, patient characteristics and service utilisation among all hospitalisations, HSMR cases and palliative patients.MethodsWe assessed all separations in the Discharge Abstract Database between fiscal years 2006–2007 and 2012–2013 for PC cases at national, provincial and facility levels. In-hospital mortality was measured among all hospitalisations (including HSMR cases) and palliative patients. We calculated a variant HSMR-PC that included PC cases.ResultsThere was an increase in the frequency of PC coding over the study period (from 0.78% to 1.12% of all separations), and year-over-year improvement in adherence to PC coding guidelines. Characteristics and resource utilisation of PC patients remained stable within provinces. Crude mortality among HSMR cases declined from 8.7% to 7.3%. National HSMR declined by 22% during the study period, compared with a 17% decline in HSMR-PC. Provincial results for HSMR-PC are not significantly different from regular HSMR calculation.ConclusionsThe introduction of a national coding standard resulted in increased identification of palliative patients and services. Aside from PC coding practices, we note numerous independent drivers of improving HSMR results, notably, a significant reduction of in-hospital mortality, and increase in admissions accompanied by a greater number of coded comorbidities. While PC impacts the HSMR indicator, its influence remains modest.
ObjectivesTo assess the utility of publicly reported performance trend results of Canadian hospitals (by hospital size/type and jurisdiction).DesignLongitudinal observational study.Setting489 hospitals in Canada between fiscal years 2012–2013 and 2016–2017.ParticipantsAnalysis focused on indicator results of individual Canadian hospitals.Primary and secondary outcomesEight outcome indicators of hospital performance: in-hospital mortality (2), readmissions (4) and adverse events (2). Performance trend outcomes of improving, weakening or no change over time. Comparators in performance by hospital size/type of above, below or same as average.ResultsAt the national level, between 2012–2013 and 2016–2017, Canadian hospitals largely reduced in-hospital mortality: hospital deaths (hospital standardised mortality ratio) −9%; hospital deaths following major surgery −11.1%. Conversely, readmission to hospital increased nationwide: medical 1.5%; obstetric 5%; patients aged 19 years and younger 4.6% and surgical 3%. In-hospital sepsis declined −7.1%. Approximately 10% of the 489 hospitals in this study had a trend of improving performance over time (n=49) in one or more indicators, and a similar number showed a weakening performance over time (n=52). Roughly half of the hospitals in this study (n=224) had no change in performance over time for at least four out of the eight indicators. No single hospital had an improving or weakening trend in more than two indicators. Teaching and larger-sized hospitals showed a higher ratio of improving performance compared with smaller-sized hospitals.ConclusionsAnalysis of Canadian hospital performance through eight indicators shows improvement of in-hospital mortality and in-hospital sepsis, but rising rates of readmissions. Subdividing the analysis by hospital size/type shows greater instances of improvement in teaching and larger-sized hospitals. There is no clear pattern of a particular province/territory with a significant number of hospitals with improving or weakening trends. The overall assessment of trends of improving and weakening as presented in this study can be used more systematically in monitoring progress.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.