Many studies determine the performance of blood glucose monitoring (BG) systems. Correct evaluation is, however, complex, and apparent contradiction of results creates confusion. This study aimed to provide an overview of frequently made errors and to develop easy-to-use checklists to verify the quality of such studies. Building on the work from Mahoney and Ellison and subsequent re-evaluation, study designs of accuracy studies were assessed, and best practice and internationally accepted norms were determined. Key issues were collated, and two simplified checklists were developed: one for the assessment of analytical accuracy studies and a second for guidance with studies assessing the influence of interferences. The checklists have been used in a feasibility study with 20 representative studies selected from a literature search between 2007 and 2012. This check revealed that limitations in the designs and methods of studies assessing the performance of BG systems are common. The use of the accuracy checklist with the 20 representative studies showed that only 20% were in agreement with most of the issues deemed important and that 40% showed clear nonconcordance with ISO 15197. The use of the interference checklist showed that only 50% of the publications were in good agreement with the quality checks. In agreement with previous studies, which concluded many evaluations are performed poorly and present questionable conclusions, the use of these checklists demonstrated that few publications adhered to international guidelines and recommendations. Taking this into consideration, it becomes obvious that the publications must be examined in more detail to establish their quality and the validity of conclusions drawn.
Rationale and ObjectiveB lood glucose (BG) systems have been widely available for many years and have become the subject of an extensive range of studies evaluating the accuracy of these products. Such studies can involve a single BG system or several. Considering the number of publications comparing the accuracy of several systems, the number of publications has been increasing significantly over the last 5 years. A nondefinitive estimate based on the search undertaken is provided in Figure 1.Building on the work from Mahoney and Ellison 1,2 and subsequent re-evaluation, 3 study designs of accuracy studies were assessed, and best practice and internationally accepted norms were determined. The evaluation of BG system accuracy and the influence of interferences is complex, and testing must be carefully designed and performed. 4 Clinicians and technicians performing such studies need to be aware of numerous factors in order to obtain data free of protocol-bias or patient-specific bias.5 A wide range of variables must be taken into account to ensure any inaccuracy of results is due to the BG system and not due to other factors such as the reference method, variations in the specimens compared, experimental artifact, random patient interferences, or using the meter outside the manufacturer's claim...