Development of Quality Metrics to Evaluate Pediatric Hematologic Oncology Care in the Outpatient Setting

Abstract

Introduction: Systems to quantify and incentivize quality of care (QoC) have been developed in multiple healthcare settings. In pediatric oncology, lists of QoC metrics or recommendations have been procured through consensus methodologies such as the Delphi process. To date, no QoC metrics have been developed for outpatient pediatric oncology. Objectives: The aim of this study was to develop a list of QoC metrics for the leukeumia-lymphoma (LL) clinic at the Hospital for Sick Children in Toronto, using a consensus process that could be adapted to other clinic settings. Methods: A modified Delphi process following the American Society of Clinical Oncology (ASCO) guidelines was used to generate consensus on a list of QoC metrics (Loblaw et al., 2012). A Medline-Ovid search was conducted for quality indicators, metrics and recommendations relevant to pediatric oncology. Results were screened for (a) system-level metrics that could be translated to a clinic level and (b) clinic-level recommendations that could be converted to measurable quantities. Additional metrics outside the literature search were considered. A provisional list was compiled and circulated electronically to local stakeholders, including medical and nursing staff (n=10). Stakeholders ranked each metric on a 5-point Likert scale based on importance and feasibility of measurement (round 1). Stakeholders provided feedback on the metrics and suggested additional metrics. Median, interquartile range and full ranges were calculated for each metric. A metric was considered to reach consensus if the percent of respondents ranking within two consecutive scores was ≥70%. Results and comments from round 1 were re-circulated to stakeholders in personalized reports. This allowed each stakeholder to compare his or her previous scores with overall scores for each metric. Stakeholders were asked to re-rank each metric (round 2). Results: The literature search yielded 2 relevant publications from which a provisional list of 27 metrics was generated. Metrics were grouped into 7 categories (Table 1). In round 1, 19/27 (70%) metrics reached consensus. Stakeholders’ comments resulted in 4 new metrics and edits to 8 original metrics. All metrics were included in round 2 for a total of 31. Twenty-four of 31 (77%) metrics reached consensus after round 2 (Table 1). Thirteen were chosen for the final list based on highest consensus scores, highest interquartile and full ranges, and minimizing redundancy. Conclusion: This study demonstrates the feasibility of using a modified Delphi process to generate QoC metrics for a pediatric hematology oncology clinic, and provides a model other clinics may employ for local use. The final metrics will be used to evaluate the quality of care in the LL clinic, and to identify areas for improvement in clinic function. Figure 1 Figure 1. Disclosures No relevant conflicts of interest to declare.

Use of quality indicators in neuroblastoma treatment: A feasibility assessment

“…This study continues along the same lines of previous studies into QI feasibility, in other areas of healthcare, where QIs are increasingly being used, such as adult cancer, 25–27 cardiovascular disease, 28 and rheumatology 29 . Knops et al 17 underlined the importance of development of QIs for childhood cancer, and in the past two decades, some sets of QIs have been proposed for pediatric oncology care 30–35 . However, no prior studies were found that investigated NBL QIs specifically.…”

“…29 Knops et al 17 underlined the importance of development of QIs for childhood cancer, and in the past two decades, some sets of QIs have been proposed for pediatric oncology care. [30][31][32][33][34][35] However, no prior studies were found that investigated NBL QIs specifically.…”

Establishing nursing‐sensitive quality indicators for pediatric oncology: An international mixed methods Delphi study

“…Chemotherapy‐related quality indicators have been developed in international adult and pediatric oncology studies that may be relevant to nursing. Such indicators reflect structures, processes, and outcomes such as: chemotherapy administration competency, closed system transfer devices; administration delays, documented start and stop times/scheduled delivery, guideline‐adherent processes, personal protective equipment use; and drug dose errors (Bradley et al, 2013a; Looper et al, 2016; Teichman et al, 2017). Potential indicators nominated by expert panelists in Round One open‐ended responses include: patient identification; safe medication administration; adverse event documentation; and extravasation rates (Jackson‐Rose et al, 2017; Looper et al, 2016).…”

“…Pain assessment and management is a well‐established NSI in adults and pediatrics (Montalvo, 2007; Start et al, 2018). It has also been selected as a pediatric oncology quality indicator for HIC and LMIC (Teichman et al, 2017; Wong et al, 2017). Although pain is one of several common symptoms in pediatric oncology, both pain and symptom assessment/management were included in the preliminary core set by expert panel members; highlighting pain as a priority symptom for pediatric oncology nursing assessment/management internationally.…”

Emergency Department Chief Complaints Among Children With Cancer

“…Therefore, pain assessment has been identified as an important quality measure for the outpatient care of children with cancer. 17 It is essential that we not only assess pain in this unique population, but also provide sufficient anticipatory guidance for caregivers along with at-home prescription medications.…”