High-quality performance of medical devices for glucose monitoring is important for a safe and efficient usage of this diagnostic option by patients with diabetes. The mean absolute relative difference (MARD) parameter is used most often to characterize the measurement performance of systems for continuous glucose monitoring (CGM). Calculation of this parameter is relatively easy and comparison of the MARD numbers between different CGM systems appears to be straightforward on the first glance. However, a closer look reveals that a number of complex aspects make interpretation of the MARD numbers provided by the manufacturer for their CGM systems difficult. In this review, these aspects are discussed and considerations are made for a systematic and appropriate evaluation of the MARD in clinical trials. The MARD should not be used as the sole parameter to characterize CGM systems, especially when it comes to nonadjunctive usage of such systems.
MARD values from clinical studies should not be used blindly but the reliability of the evaluation should be considered as well. Furthermore, it should not be ignored that MARD does not take into account the key feature of CGM sensors, the frequency of the measurements. Additional metrics, such as precision absolute relative difference (PARD) should be used as well to obtain a better evaluation of the CGM performance for specific uses, for example, for artificial pancreas.
Introduction: The accuracy of continuous glucose monitoring (CGM) systems is often assessed with respect to blood glucose (BG) readings. CGM readings are affected by a physiological and a technical time delay when compared to BG readings. In this analysis, the dependence of CGM performance parameters on the BG rate of change was investigated for 2 CGM systems. Methods: Data from a previously published study were retrospectively analyzed. An established CGM system (Dexcom G4, Dexcom, San Diego, CA; system A) and a prototype system (Roche Diagnostics GmbH, Mannheim, Germany; system B) with 2 sensors each were worn by 10 subjects in parallel. Glucose swings were induced to achieve rapidly changing BG concentrations. Mean absolute relative differences (MARD) were calculated in different BG rate-of-change categories. In addition, sensor-to-sensor precision was assessed. Results: At BG rates of change of –1 mg/dl/min to 0 mg/dl/min and 0 mg/dl/min to +1 mg/dl/min, MARD results were 12.6% and 11.3% for system A and 8.2% and 10.0% for system B. At rapidly changing BG concentrations (<–3 mg/dl/min and ≥+3 mg/dl/min), higher MARD results were found for both systems, but system B was less affected (system A: 24.9% and 29.6%, system B: 10.6% and 16.3%). The impact of rate of change on sensor-to-sensor precision was less pronounced. Conclusions: Both systems were affected by rapidly changing BG concentrations to some degree, although system B was mostly unaffected by decreasing BG concentrations. It would seem that technological advancements in CGM systems might allow for a more precise tracking of BG concentrations even at rapidly changing BG concentrations.
Evaluation of CGM performance studies should follow an identical study design, including sufficient swings in glycemia. At least a part of the study participants should wear two identical CGM sensors in parallel. All data available should be used for evaluation, both by MARD and PARD, a good PARD value being a precondition to trust a good MARD value. Results should be analyzed and presented separately for clinically different categories, e.g., hypoglycemia, exercise, or night and day.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.