Test of Gross Motor Development-2 Scores Differ Between Expert and Novice Coders

Palmer, Kara K.; Brian, Ali

doi:10.1123/jmld.2015-0035

Cited by 18 publications

(19 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The rest of them (13) used 2 evaluators. Intraclass correlation (ICC) was calculated in most studies except in four in which Pearson correlation [ 21 ], Kappa statistic [ 33 , 45 ] or content validity index (CVI) [ 38 ] were used. ≈70% of the inter-rater statistics reported regarding to locomotor and ball skills’ score, overall score or GMQ were over 0.9.…”

Section: Resultsmentioning

confidence: 99%

“…≈70% of the inter-rater statistics reported regarding to locomotor and ball skills’ score, overall score or GMQ were over 0.9. Only two studies shown inter-rater reliability values lower than 0.75 (ICC) [ 48 ] or 0.7 (kappa) [ 33 ], the last one comparing expert with novice coders. Scores of each individual skill were reported in 6 studies with more than ≈90% of the inter-rater reliability values over 0.6, ≈30% over 0.9 (ICC calculated in all comparisons) [ 35 , 36 , 42 , 46 , 48 , 50 ] (Figs 2 and 3 ).…”

Section: Resultsmentioning

confidence: 99%

“…However, rater familiarisation, training, and experience in TGMD administration were not systematically reported or described in the studies included in this systematic review. In addition, the academic background of the raters is heterogeneous, varying from graduate students (physical education [ 35 , 36 , 48 ] and sport sciences [ 36 ]), master’s students [ 43 , 44 ], doctoral students [ 33 , 43 , 50 ], physical therapists and physiatrists [ 37 ], or paediatric physiotherapists [ 39 ]. Previous evidence underscores the need to provide standardised training protocols for coding using process-oriented approaches like TGMD-2 and TGMD-3 for valid and reliable results [ 46 ].…”

Section: Discussionmentioning

confidence: 99%

“…Previous evidence underscores the need to provide standardised training protocols for coding using process-oriented approaches like TGMD-2 and TGMD-3 for valid and reliable results [ 46 ]. However, to the best of our knowledge, only one study analysed scoring differences using TGMD-2 between expert and novice coders [ 33 ]. The results showed that novice (undergraduate students in physical education with a two-hour training session on coding process) and expert (doctoral student in motor behaviour with more than 3 years of experience coding the TGMD-2) raters produced significantly different scores except for the kick and the gallop [ 33 ], suggesting a need for more extensive training until agreement is obtained.…”

Section: Discussionmentioning

confidence: 99%

See 3 more Smart Citations

Reliability of the test of gross motor development: A systematic review

et al. 2020

View full text Add to dashboard Cite

Objective To identify, synthesise and evaluate studies that investigated the reliability of the Test of Gross Motor Development (TGMD) variants. Methods A systematic search was employed to identify studies that have investigated internal consistency, inter-rater, intra-rater and test-retest reliability of the TGMD variants through Scopus, Pubmed/MEDLINE, PsycINFO, Sport Discus and Web of Science databases. Results Of the 265 studies identified, 23 were included. Internal consistency, evaluated in 14 studies, confirming good-to-excellent consistency for the overall score and general motor quotient (GMQ), and acceptable-to-excellent levels in both subscales (locomotor and ball skills). Inter-rater reliability, evaluated in 19 studies, showing good-to-excellent intra-class correlation coefficient (ICC) values in locomotor skills score, ball skills score, overall score, and GMQ. Intra-rater reliability, evaluated in 13 studies, displaying excellent ICC values in overall score and GMQ, and good-to-excellent ICC values in locomotor skills score and ball skills score. Test-retest reliability was evaluated in 15 studies with 100% of the statistics reported above the threshold of acceptable reliability when ICC was not used. Studies with ICC statistic showed good-to-excellent values in ball skills score, overall score, and GMQ; and moderate-to-excellent values in locomotor skills score. Conclusions Overall, the results of this systematic review indicate that, regardless of the variant of the test, the TMGD has moderate-to-excellent internal consistency, good-to-excellent inter-rater reliability, good-to-excellent intra-rater reliability, and moderate-to-excellent test-retest reliability. Considering the few high-quality studies in terms of internal consistency, it would be recommend to carry out further studies in this field to improve their quality. Since there is no gold standard for assessing FMS, TGMD variants could be appropriate when opting for a psychometrical robust test. However, standardized training protocols for coding TGMD variants seem to be necessary both for researchers and practitioners in order to ensure acceptable reliability.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Resultsmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

See 2 more Smart Citations

Reliability of the test of gross motor development: A systematic review

et al. 2020

View full text Add to dashboard Cite

show abstract

“…A este respecto, conviene mencionar que las personas que realizaron las labores de evaluación y puntuación en este estudio conocían la batería TGMD-2 y estaban familiarizadas con su administración, hecho que favorece la obtención de un elevado grado de correlación test-retest (Palmer, 2016).…”

Section: Discussionunclassified

Fiabilidad y Validez de la Batería TGMD-2 en Población Española

Ayán¹,

Cancela²,

Sánchez-Lastra³

et al. 2019

REV IBEROAM DIAGN EV

View full text Add to dashboard Cite

ResumenEste estudió analizó la fiabilidad y la validez de una versión en castellano de la batería de evaluación del desarrollo motor TGMD-2. Un total de 84 niños cumplimentaron la batería en dos ocasiones, con un intervalo de dos semanas para computar su fiabilidad test-retest. Dos evaluadores valoraron independientemente los resultados y se analizó fiabilidad inter-evaluador. Se estudió la validez de constructo siguiendo las indicaciones del manual de la batería y se valoró la condición física de los participantes para determinar la validez concurrente. Se obtuvo un elevado grado de fiabilidad test-retest y de fiabilidad interevaluador. La validez de constructo obtenida fue similar y la validez concurrente inferior a la reportada en otros estudios de adaptación transcultural. La TGMD-2 es fiable al objeto de valorar el desarrollo motor cuando se administra en niños españoles. Futuros estudios con muestras más amplias son necesarios para aportar información más sólida sobre su validez. AbstractThis study aimed at analysing the reliability and validity of a Spanish version of the TGMD-2, once it was observed the lack of studies in this regard. A total of 84 children performed the battery twice, with a twoweek interval in order to identify its test-retest reliability. Two evaluators assessed the results obtained in the test phase, in order to analyse its intra-observer reliability. The construct validity was assessed following the official manual of the battery and the fitness level of the participants was also measured as a way to identify the concurrent validity. High levels of test-retest and intra-observer reliability were found. The construct validity was similar and the concurrent validity was lower than in other cultural adaptation studies. The obtained results show that the TGMD-2 is a reliable tool when administered to Spanish children. Future studies with greater samples are needed to confirm the degree of validity.

show abstract