Reproducible research in sport and exercise psychology: The role of sample sizes

Schweizer, Geoffrey; Furley, Philip

doi:10.1016/j.psychsport.2015.11.005

Cited by 125 publications

(96 citation statements)

References 35 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Although it is debated whether the problem has arisen to the level of a crisis, one outcome of this discussion is an increased awareness of the effect of conventional scientific practices on the conclusions we draw from our studies. One area that has received attention is the effect of less‐than‐optimal sample sizes on false positive and false negative conclusions (Button et al., ; Fraley & Vazire, ; Schweizer & Furley, ; Vadillo, Konstantinidis, & Shanks, ). This is particularly an issue in fields or areas of inquiry in which subject populations are difficult to identify or recruit, or in which the testing of individual subjects is time‐consuming and expensive.…”

mentioning

confidence: 99%

Sample Size, Statistical Power, and False Conclusions in Infant Looking‐Time Research

Oakes

2017

Infancy

175

127

View full text Add to dashboard Cite

Infant research is hard. It is difficult, expensive, and time consuming to identify, recruit and test infants. As a result, ours is a field of small sample sizes. Many studies using infant looking time as a measure have samples of 8 to 12 infants per cell, and studies with more than 24 infants per cell are uncommon. This paper examines the effect of such sample sizes on statistical power and the conclusions drawn from infant looking time research. An examination of the state of the current literature suggests that most published looking time studies have low power, which leads in the long run to an increase in both false positive and false negative results. Three data sets with large samples (>30 infants) were used to simulate experiments with smaller sample sizes; 1000 random subsamples of 8, 12, 16, 20, and 24 infants from the overall samples were selected, making it possible to examine the systematic effect of sample size on the results. This approach revealed that despite clear results with the original large samples, the results with smaller subsamples were highly variable, yielding both false positive and false negative outcomes. Finally, a number of emerging possible solutions are discussed.

show abstract

mentioning

confidence: 99%

Sample Size, Statistical Power, and False Conclusions in Infant Looking‐Time Research

Oakes

2017

Infancy

175

127

View full text Add to dashboard Cite

show abstract

“…Most studies had a small sample size and few provided evidence of sample size estimation. This calls into question the statistical power of the studies,55 56 and draws potential concerns over the reproducibility of the findings 57. There is also a lack of replication research within this field 57.…”

Section: Discussionmentioning

confidence: 99%

“…This calls into question the statistical power of the studies,55 56 and draws potential concerns over the reproducibility of the findings 57. There is also a lack of replication research within this field 57. The definition of injuries varied across studies, ranging from no definition36 to varying time loss definitions 45.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Psychological interventions used to reduce sports injuries: a systematic review of real-world effectiveness

2018

View full text Add to dashboard Cite

show abstract

“…The low sample size limits the strength of evidence of the present study (Button et al 2013;Lohse, Buchanan & Miller, 2016;Schweizer & Furley, 2016). Recruiting a sufficient number of high-skilled football players for penalty kick studies is typically very difficult.…”

Section: Limitations and Future Challengesmentioning

confidence: 94%

Implicit learning increases shot accuracy of football players when making strategic decisions during penalty kicking

Navarro

Kamp

Schor

et al. 2018

Human Movement Science

View full text Add to dashboard Cite

A B S T R A C TImplicit learning has been proposed to improve athletes' performance in dual-task situations. Yet, only a few studies tested this with a sports-relevant dual-task. Hence, the current study aimed to compare the effects of implicit and explicit training methods on penalty kicking performance. Twenty skilled football players were divided in two training groups and took part in a practice phase to improve kicking accuracy (i.e., without a goalkeeper) and in a post-test in order to check penalty kick performance (i.e., accuracy including a decision to kick to the side opposite the goalkeeper's dive). Results found that the implicit and explicit training method resulted in similar levels of decision-making, but after implicit training this was achieved with higher kicking accuracy. Additionally, applications for football players and coaches are discussed.

show abstract

Reproducible research in sport and exercise psychology: The role of sample sizes

Cited by 125 publications

References 35 publications

Sample Size, Statistical Power, and False Conclusions in Infant Looking‐Time Research

Sample Size, Statistical Power, and False Conclusions in Infant Looking‐Time Research

Psychological interventions used to reduce sports injuries: a systematic review of real-world effectiveness

Implicit learning increases shot accuracy of football players when making strategic decisions during penalty kicking

Contact Info

Product

Resources

About