Reliable measurement in sport psychology: The case of performance outcome measures

Schweizer, Geoffrey; Furley, Philip; Rost, Nicolas; Barth, Kai

doi:10.1016/j.psychsport.2020.101663

Cited by 16 publications

(20 citation statements)

References 49 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The results indicate the video-based decision-making diagnostic instrument can discriminate decisionmaking competence within a high-per-formance youth group, in particular for playing status and to some extent age. Although the reliability of the diagnostic instrument is satisfied for the build-up category, future research should aim for higher reliability for all measured variables (e.g., offensive decision), by using the guidelines proposed, for example, by Schweizer et al (2020). Further, the results demonstrate the predictive value of the new video-based decision-making diagnostic instrument, especially the build-up situation for national youth team selection.…”

Section: Resultsmentioning

confidence: 79%

“…Here, an adequate level of reliability for the build-up situations was found; however, the lower reliability for offensive situations has to be considered as a larger limitation. A potential reason for the lower reliability of the offensive situations could be due to the restriction of range phenomenon within the high-performance level group (i.e., homogeneous expert samples) the study was conducted (Schweizer et al, 2020). Despite this limitation, the current study does provide a method for establishing the reliability of the offensive decisionmaking situations.…”

Section: Discussionmentioning

confidence: 92%

“…In comparison to the assessment of manifest variables (e.g., time, height, distance), the measurement of latent constructs such as decision-making competence poses a much larger challenge. While researchers have highlighted the limited reporting of reliability for new diagnostic instruments (Hadlow et al, 2018;Schweizer, Furley, Rost, & Barth, 2020), a key aim of the current study was to measure the reliability of the latent construct decision-making (Objective I). Here, an adequate level of reliability for the build-up situations was found; however, the lower reliability for offensive situations has to be considered as a larger limitation.…”

Section: Discussionmentioning

confidence: 99%

“…In addition, future studies may improve the reliability of these situations by exchanging current lower reliability clips with newly developed higher reliability clips. Also adding more items to the diagnostic instrument could be an approach for improving the reliability and even reduce the need for large sample sizes (Schweizer et al, 2020).…”

Section: Discussionmentioning

confidence: 99%

See 3 more Smart Citations

Decision-making skills of high-performance youth soccer players

Murr

Larkin

Höner

2020

Ger J Exerc Sport Res

View full text Add to dashboard Cite

Objectives This study aimed to develop a valid video-based diagnostic instrument that assesses decision-making with a sport-specific motor response. Methods A total of 86 German youth academy players (16.7 ± 0.9 years) viewed game situations projected on a large video screen and were required to make a decision by dribbling and passing to one of three targets (representing different decision options). The test included 48 clips separated into two categories: build-up (bu) and offensive decisions (off). Criterion-related validity was tested based on age (i.e., U16, U17, and U19), playing status (i.e., minutes played in official matches of the current season) and in a prospective approach relating to future youth national team status (i.e., selected or nonselected). Finally, it was investigated whether decision-making competence was influenced by playing position (i.e., defenders vs. midfielders vs. forwards). Results Instrumental reliability demonstrated satisfactory values for SCbu (r = 0.72), and lower for SCoff (r = 0.56). Results showed the diagnostic instrument is suitable for discriminating between playing status (SCbu: Φ = 0.22, p < 0.01; SCoff: Φ = 0.14, p < 0.05) and between younger (U16) and older players (U17 > U16 in SCbu: Φ = 0.24 and SCoff: Φ = 0.39, p < 0.01; U19 > U16 in SCbu: Φ = 0.41 and SCoff: Φ = 0.46, p < 0.01); however, there was no difference between U17 and U19 players. Furthermore, the predictive value of the test indicates that future youth national team players make better decisions with respect to the build-up category (SCbu: Φ = 0.20; p < 0.05), whereas playing position did not significantly influence decision-making competence. Conclusion Results indicate the video-based decision-making diagnostic instrument can discriminate decision-making competence within a high-performance youth group. The outcomes associated with national youth team participation demonstrate the predictive value of the diagnostic instrument. This study provides initial evidence to suggest a new video-based diagnostic instrument with a soccer-specific motor response can be used within a talent identification process to assist with assessment of decision-making performance.

show abstract

Section: Resultsmentioning

confidence: 79%

Section: Discussionmentioning

confidence: 92%

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

See 2 more Smart Citations

Decision-making skills of high-performance youth soccer players

Murr

Larkin

Höner

2020

Ger J Exerc Sport Res

View full text Add to dashboard Cite

show abstract

“…However, none of these comparisons reached statistical significance. Based on these findings, we conclude that the factor nationality does not explain meaningful variance in penalty performance and the explanation for the poor performance in penalty shootouts of the England national team in the past most likely lies with other factors including the unreliable measurement of penalty performance 18 . Moreover, it is likely that cognitive biases like the availability heuristic 19 lead people to overgeneralize based on salient (e.g., emotional) events that readily come to mind (e.g., a loss in an important penalty shootout).…”

Section: Discussionmentioning

confidence: 84%

English Football Players are not as Bad at Kicking Penalties as Commonly Assumed

Brinkschulte

Furley

Memmert

2020

Sci Rep

Self Cite

View full text Add to dashboard Cite

the previous performance of the english men's national football team in penalty shootouts has led to the widespread stereotype that english football players are particularly bad at scoring penalties. Research has proposed possible reasons behind this alleged "penalty curse". When looking at these reasons, the question arises if english football players per se have trouble scoring penalty kicks. therefore, we analyzed the performance of a large sample of penalty takers during all World-and european championships (N = 696) and, additionally, in some of the highest European leagues over a ten-year period (N = 4,708). The results reveal no significant differences between the success rates (on average between 71-79%, depending on the type of penalty kick and on the type of competition) of penalty takers from different nations. Therefore, we conclude that English players perform as well as players from other nations and that poor performance in penalties lay beyond the factor nationality. Penalty kicks play an important role in association football (soccer) and will likely play an important role in upcoming events like the UEFA European Championship 2021. UEFA introduced penalty shootouts to major tournaments in 1976 (FIFA followed in 1978) as a means of deciding matches in the knockout phase of major tournaments when the score is a draw at the end of the match. These shootouts have decided 18 UEFA European Championship matches including one for winning the tournament (1976) as well as 30 FIFA World Cup matches including two for winning the World Cup trophy (1994 and 2006) and can be considered as the pinnacle of high-pressure performance in football 1,2. Pertinent to the present research, studies have suggested that not all nations perform equally well in these high-stakes penalty situations 3-5. One specific result from this research has received an extraordinary amount of public attention, which has led to a well-known stereotype: English football players are extremely bad at shooting penalties. It is, in fact, nearly impossible to find opposing opinions about this stereotype in the media, and even acknowledged football experts in television commentaries openly talk about how bad England are at penalties-an opinion that vast amounts of newspaper and magazine reports seemingly support 6-9. As is often the case with stereotypes, there may be some truth behind it. A brief look at the numbers of the penalty shootouts involving the England national team does in fact show a negative balance. Since 1978, the England men's national team has only won three out of the nine shootouts they participated in (losses: World

show abstract