2015
DOI: 10.1051/epjconf/20149502003
|View full text |Cite
|
Sign up to set email alerts
|

Extraordinary claims: the 0.000029% solution

Abstract: Abstract. The five-standard-deviation threshold is an established standard for discovery claims in experimental particle physics; however, the criterion is an ad-hoc recipe with no solid foundations. In this report I discuss its origins and the issues it was designed to address, pointing out its shortcomings and the need for a more flexible approach to decide when a new observed effect should be taken seriously.

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
1
1

Citation Types

0
6
0

Year Published

2017
2017
2020
2020

Publication Types

Select...
5

Relationship

1
4

Authors

Journals

citations
Cited by 5 publications
(6 citation statements)
references
References 17 publications
0
6
0
Order By: Relevance
“…First, the first post-countermovement force value less than 10 N and the next force value greater than 10 N were identified; second, points 30 ms after and before these points, respectively, were identified to determine the center ‘flight phase’ array; third, mean and SD ‘flight phase’ force was calculated, and mean ‘flight phase’ force plus 5 SD was used to identify take-off [14]. We chose the 5 SD threshold because it provides the most robust approach, with the chance of it not identifying a ‘real’ change in force being 1 in 3.5 million [15]. The propulsion phase was automatically identified for the Push Band method using its proprietary software.…”
Section: Methodsmentioning
confidence: 99%
“…First, the first post-countermovement force value less than 10 N and the next force value greater than 10 N were identified; second, points 30 ms after and before these points, respectively, were identified to determine the center ‘flight phase’ array; third, mean and SD ‘flight phase’ force was calculated, and mean ‘flight phase’ force plus 5 SD was used to identify take-off [14]. We chose the 5 SD threshold because it provides the most robust approach, with the chance of it not identifying a ‘real’ change in force being 1 in 3.5 million [15]. The propulsion phase was automatically identified for the Push Band method using its proprietary software.…”
Section: Methodsmentioning
confidence: 99%
“…Published by the Royal Society under the terms of the Creative Commons Attribution License http://creativecommons.org/licenses/by/4.0/, which permits unrestricted use, provided the original author and source are credited. eventually led to an ad hoc '5-sigma' discovery criterion [3][4][5][6], i.e. a 'discovery' is only taken seriously if the estimated probability for observing the result without new physics is less than the chance of a single sample from a Normal distribution being more than five standard deviations (5σ ) from the mean.…”
Section: Introductionmentioning
confidence: 99%
“…The method devised in [268] enables a non-CPU-intensive evaluation of the "global significance" of an observed effect, accounting for the multiplicity of ways by which the signal may appear in the search. One should however note that only the local significance of a signal search may be well-defined, given the arbitrariness intrinsic in the definition of the range of variability allowed to the nuisance parameter describing the composite alternative hypothesis [269].…”
Section: Hypothesis Testing Confidence Intervals and Signal Extractionmentioning
confidence: 99%