Clinical trial monitoring effectiveness: Remote risk-based monitoring versus on-site monitoring with 100% source data verification

Abstract

Background/Aims: Traditional on-site monitoring of clinical trials via frequent site visits and 100% source data verification is cost-consuming, and it still cannot guarantee data quality effectively. Depending on the types and designs of clinical trials, an alternative would be combining several monitoring methods, such as risk-based monitoring and remote monitoring. However, there is insufficient evidence of its effectiveness. This research compared the effectiveness of risk-based monitoring with a remote monitoring system with that of traditional on-site monitoring. Methods: With a cloud-based remote monitoring system called beagle View®, we created a remote risk-based monitoring methodology that focused only on critical data and processes. We selected a randomized controlled trial conducted at Tohoku University Hospital and randomly sampled 11 subjects whose case report forms had already been reviewed by data managers. Critical data and processes were verified retrospectively by remote risk-based monitoring; later, all data and processes were confirmed by on-site monitoring. We compared the ability of remote risk-based monitoring to detect critical data and process errors with that of on-site monitoring with 100% source data verification, including an examination of clinical trial staff workload and potential cost savings. Results: Of the total data points (n = 5617), 19.7% (n = 1105, 95% confidence interval = 18.7–20.7) were identified as critical. The error rates of critical data detected by on-site monitoring, remote risk-based monitoring, and data review by data managers were 7.6% (n = 84, 95% CI = 6.2–9.3), 7.6% (n = 84, 95% confidence interval = 6.2–9.3), and 3.9% (n = 43, 95% confidence interval = 2.9–5.2), respectively. The total number of critical process errors detected by on-site monitoring was 14. Of these 14, 92.9% (n = 13, 95% confidence interval = 68.5–98.7) and 42.9% (n = 6, 95% confidence interval = 21.4–67.4) of critical process errors were detected by remote risk-based monitoring and data review by data managers, respectively. The mean time clinical trial staff spent dealing with remote risk-based monitoring was 9.9 ± 5.3 (mean ± SD) min per visit per subject. Our calculations show that remote risk-based monitoring saved between 9 and 41 on-site monitoring visits, corresponding to a cost of between US$13,500 and US$61,500 per trial site. Conclusion: Remote risk-based monitoring was able to detect critical data and process errors as well as on-site monitoring with 100% source data verification, saving travel time and monitoring costs. Remote risk-based monitoring offers an effective alternative to traditional on-site monitoring of clinical trials.

Monitoring metrics over time: Why clinical trialists need to systematically collect site performance metrics

“…The metrics chosen for Trial 3 were more volatile, with many triggers firing intermittently. By contrast, Trial two monitored more metrics (17) but also had more metrics that were never triggered, than the other two trials.…”

“…A similar emphasis is found in numerous retrospective studies. [14][15][16][17] Metrics are numeric measurements, in this case mostly obtained and calculated from data held in the trial's database, and used to evaluate a site's risk or performance. These metrics may be compared between sites or with set thresholds to highlight potential or actual risks and under-performance, and this may trigger an action, ranging from simply contacting the site to discuss the reasons for any issue, to conducting an onsite visit, or discussion with trial oversight committees.…”

Evaluating registry-based trial economics: Results from the STRESS clinical trial

“…RCT designers should specify which question they are addressing and design their endpoint assessment strategy accordingly. Although the present study's Explanatory design offered onsite monitoring and 10 % source document verification (SDV), researchers have long questioned the value of these services (both their costs and their effectiveness) [ [39] , [40] , [41] , [42] , [43] ]. Essentially, 10 % SDV means that 90 % of endpoints are not subject to SDV.…”

An approach to virtual clinical trial site visits: Lessons from the MeTeOR trial

“…To our knowledge, this is the first published framework for a comprehensive, real-time virtual site visit in place of an in-person review. Use of centralized remote data monitoring to supplement in-person visits is widespread [ 2 ], and prior research has examined specific risk-based monitoring and electronic data capture tools for this purpose [ [11] , [12] , [13] , [14] ]. During the COVID-19 pandemic, remote site initiation visits and monitoring became more common, with some investigators emphasizing the utility of these methods to decrease costs and increase efficiency even as pandemic restrictions ease [ [15] , [16] , [17] ].…”