Design and Analysis of Method Equivalence Studies

Abstract

Method equivalence assessments should be considered when analytical methods are either modified or substituted. The TOST (two one sided tests) approach provides a sounder data driven method for testing equivalence than a simple comparative intermediate precision study which is typically performed as part of method validation. Prior to designing an equivalency study, an acceptance criterion (an acceptable bias between original and modified/changed method) must be chosen. The choice of acceptance criteria requires the identification of the smallest mean difference or bias between methods that is practically important. Equivalence testing in this manner is used to prove that the new method can generate data which continues to support previously established specifications. Once the acceptance criterion is decided, other aspects of the study can be designed following a set of design principles. When the design and acceptance criteria have been established, the collection of the data can commence. Demonstration of equivalence should not start until the validity of the observations has been confirmed such as assessment for outliers, normality, and comparison of variances. Once the suitability of the data is confirmed, the mean difference between the two data sets can be calculated along with a +/-90% confidence interval using the TOST approach. It can then be established whether equivalence of the two methods has been demonstrated.

Comparison of Intracoronary Versus Intravenous Administration of Adenosine for Measurement of Coronary Fractional Flow Reserve

“…11,12 A difference of δ=0.005 between 2 FFR results was predefined. Such a small difference was considered not to have a clinically relevant impact on interpretation and classification of FFR results.…”

A new sledge jump system that allows almost natural reactive jumps

“…For this purpose, the 90% confidence interval (CI) was calculated for the differences between the two groups. The acceptable bounds were determined for each parameter separately, based on the differences observed between the first 20 and the second 20 jumps of the NH (Borman et al, 2009). If the differences were statistically insignificant (i.e.…”

Equivalence of Temperature Measurement Methods in the Adult Hematology/Oncology Population

“…Equivalence was tested using the two one-sided tests method (Borman, Chatfield, Damjanov, & Jackson, 2009) (see Table 2). The two one-sided tests method is used for equivalence testing.…”