Background:
The Pediatric Cardiac Critical Care Consortium (PC4) is a multi-institutional quality improvement registry focused on the care delivered in the cardiac ICU for patients with CHD and acquired heart disease. To assess data quality, a rigorous procedure of data auditing has been in place since the inception of the consortium.
Materials and methods:
This report describes the data auditing process and quantifies the audit results for the initial 39 audits that took place after the transition from version one to version two of the registry’s database.
Results:
In total, 2219 total encounters were audited for an average of 57 encounters per site. The overall data accuracy rate across all sites was 99.4%, with a major discrepancy rate of 0.52%. A passing score is based on an overall accuracy of >97% (achieved by all sites) and a major discrepancy rate of <1.5% (achieved by 38 of 39 sites, with 35 of 39 sites having a major discrepancy rate of <1%). Fields with the highest discrepancy rates included arrhythmia type, cardiac arrest count, and current surgical status.
Conclusions:
The extensive PC4 auditing process, including initial and routinely scheduled follow-up audits of every participating site, demonstrates an extremely high level of accuracy across a broad array of audited fields and supports the continued use of consortium data to identify best practices in paediatric cardiac critical care.
Background:
The Pediatric Acute Care Cardiology Collaborative (PAC3) was established to improve acute care cardiology outcomes through the development of an accurate and well-validated clinical registry. We report the validation results of the initial PAC3 registry audits and describe a novel regional audit format developed to accommodate a rapidly expanding membership facilitate collaborative learning and allow for necessary modification due to the COVID-19 pandemic.
Materials and methods:
Six hospitals were audited using a regional audit format and three hospitals were subsequently audited virtually. Critical and challenging-to-collect data elements were audited among at least 40 randomly selected cases. Discrepancies were categorised as either major or minor depending on their relative importance to patient outcomes and clinical care. Results were tabulated and reported.
Results:
We audited 386 encounters and 27,086 individual data fields across 9 hospitals. The aggregate overall accuracy rate was 99.27% and the aggregate major discrepancy rate was 0.51%. The overall accuracy rate ranged from 98.77% to 99.59%, and the major discrepancy rate ranged from 0.26% to 0.88% across the cohort. No appreciable difference was seen between audit formats. Both the regional and virtual audit methods were viewed favourably by participants.
Conclusions:
A low data discrepancy rate was found demonstrating that the PAC3 registry is a highly accurate data source for use in quality improvement, benchmarking, and research. Regional audits and virtual audits were both successfully implemented.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.