2003
DOI: 10.22237/jmasm/1067645160
|View full text |Cite
|
Sign up to set email alerts
|

A Comparison Of Equivalence Testing In Combination With Hypothesis Testing And Effect Sizes

Abstract: Equivalence testing, an alternative to testing for statistical significance, is little used in educational research. Equivalence testing is useful in situations where the researcher wishes to show that two means are not significantly different. A simulation study assessed the relationships between effect size, sample size, statistical significance, and statistical equivalence.

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1
1

Citation Types

1
5
0

Year Published

2011
2011
2020
2020

Publication Types

Select...
7

Relationship

0
7

Authors

Journals

citations
Cited by 8 publications
(6 citation statements)
references
References 33 publications
1
5
0
Order By: Relevance
“…This is also confirmed by the metrics in Table I. For each metric, we compared the performance of both the embedded and MATLAB controller and tested statistical equivalence in terms of an equivalence test; see, for example, [45]. Unlike the more common statistical difference tests (like the T-test or the ranksum test), the equivalence test checks the hypothesis that means of the two samples are different; rejection of this hypothesis at some significance level (we consider 0.05) implies equivalence of the two samples with high confidence.…”
Section: Hardware-in-the-loop Experimental Evaluationsupporting
confidence: 55%
“…This is also confirmed by the metrics in Table I. For each metric, we compared the performance of both the embedded and MATLAB controller and tested statistical equivalence in terms of an equivalence test; see, for example, [45]. Unlike the more common statistical difference tests (like the T-test or the ranksum test), the equivalence test checks the hypothesis that means of the two samples are different; rejection of this hypothesis at some significance level (we consider 0.05) implies equivalence of the two samples with high confidence.…”
Section: Hardware-in-the-loop Experimental Evaluationsupporting
confidence: 55%
“…Moreover, Seaman and Serlin (1998) and Tryon (2001) discussed equivalence confidence intervals for two-group comparisons in psychological methods. Mecklin (2003) used equivalence testing in conjunction with standard hypothesis testing and effect sizes, and Cribbie, Gruman, and Arpin-Cribbie (2004) compared the test of equivalence with the traditional Student's t test. The objective of this type of hypothesis testing is to ask whether the test programme can reach the same effect as that of a standard one by setting an a priori critical margin.…”
Section: Introductionmentioning
confidence: 99%
“…Equivalence testing is useful when the researcher wants to show that two means are not statistically different and requires the identification of a clinically significant difference (d) between outcomes of competing treatments. In practice, d is often chosen to be a percentage (usually 15%-25%) of the mean of the comparison group (Mecklin, 2002). This number is then used to create a tolerance interval around zero beyond which equivalence would be rejected.…”
Section: Discussionmentioning
confidence: 99%