Wilcoxon-Mann-Whitney or t-test? On assumptions for hypothesis tests and multiple interpretations of decision rules

Abstract

In a mathematical approach to hypothesis tests, we start with a clearly defined set of hypotheses and choose the test with the best properties for those hypotheses. In practice, we often start with less precise hypotheses. For example, often a researcher wants to know which of two groups generally has the larger responses, and either a t-test or a Wilcoxon-Mann-Whitney (WMW) test could be acceptable. Although both t-tests and WMW tests are usually associated with quite different hypotheses, the decision rule and p-value from either test could be associated with many different sets of assumptions, which we call perspectives. It is useful to have many of the different perspectives to which a decision rule may be applied collected in one place, since each perspective allows a different interpretation of the associated p-value. Here we collect many such perspectives for the two-sample t-test, the WMW test and other related tests. We discuss validity and consistency under each perspective and discuss recommendations between the tests in light of these many different perspectives. Finally, we briefly discuss a decision rule for testing genetic neutrality where knowledge of the many perspectives is vital to the proper interpretation of the decision rule.

Strength matters: Tie strength as a causal driver of networks’ information benefits

“…Violation of this assumption may decrease the validity of the test especially when the sample sizes are unequal. Therefore, we also use Mann-Whitney U test as well, and all results are substantively the same (Fay and Proschan 2010;Mann and Whitney 1947).…”

Quasi-biennial oscillation effect on climate indicators: Lithuania’s case

“…In total, 20 easterly and westerly QBO events for each month were analysed. For evaluation of the statistical validity of conclusions, the Wilcoxon rank-sum test was used; WRST (Fay, Proschan 2010).…”

Exploring Precision Farming Scenarios Using Fuzzy Cognitive Maps

“…The Mann-Whitney U is a non-parametric test used to assess for significant differences in a scale or ordinal dependent variable by a single dichotomous independent variable. It is the non-parametric equivalent of the independent samples t-test [63]. More specifically, we chose to investigate the p-value in the statistical significance for the variables of K-reduction, P-reduction, N-reduction and yield-reduction predicted by the model.…”