Validity and reproducibility of a tool for assessing clinical competencies in physical therapy students

Narvaez, Martha Rocio Torres; Vargas-Pinilla, Olga-Cecilia; Rodríguez-Grande, Eliana Isabel

doi:10.1186/s12909-018-1377-x

Cited by 15 publications

(20 citation statements)

References 28 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Focusing specifically on PT, several studies highlight the relevance of having valid and reliable instruments to assess clinical competencies in different training contexts [ 51 , 52 ]. Thus, recent studies show adequate interrater reliability in the application of a rubric designed to assess undergraduate students’ use of different therapies for musculoskeletal disorders [ 53 ], the moderate internal validity of a rubric—Case History Assessment Tool (CHAT)—to assess clinical reasoning in graduates [ 54 ], or the adequate reliability and validity of a rubric—Measurement Tool for Clinical Competencies in PT (MTCCP)—designed to evaluate clinical competencies in a professional context [ 55 ].…”

Section: Introductionmentioning

confidence: 99%

Students’ Perceptions of Instructional Rubrics in Neurological Physical Therapy and Their Effects on Students’ Engagement and Course Satisfaction

Ros

Ruescas-Nicolau

Cezón‐Serrano

et al. 2021

IJERPH

View full text Add to dashboard Cite

One of the main challenges faced by physical therapy (PT) students is to learn the practical skills involved in neurological physical therapy (PT). To help them to acquire these skills, a set of rubrics were designed for formative purposes. This paper presents the process followed in the creation of these rubrics and their application in the classroom, noting that students perceived them as valid, reliable, and highly useful for learning. The perception of the validity and usefulness of the rubrics has different closely related dimensions, showing homogeneous values across the students´ sociodemographic and educational variables, with the exception of dedication to studying, which showed a significant relationship with schoolwork engagement and course satisfaction. The adequacy of the hypothesized structural model of the relationships among the variables was confirmed. Direct effects of the perception of the rubrics’ validity and engagement on course satisfaction were found, as well as direct effects of the assessment of the usefulness of the rubrics on schoolwork engagement and indirect effects on course satisfaction through this latter variable. The results are discussed taking into account the conclusions of previous research and different instructional implications.

show abstract

Section: Introductionmentioning

confidence: 99%

Students’ Perceptions of Instructional Rubrics in Neurological Physical Therapy and Their Effects on Students’ Engagement and Course Satisfaction

Ros

Ruescas-Nicolau

Cezón‐Serrano

et al. 2021

IJERPH

View full text Add to dashboard Cite

show abstract

“…Despite their pragmatism, there are scarce rubrics published in the international literature for the assessment of Physiotherapy Practicums [12,[35][36][37]. Thus, some tools can be found, such as the one proposed by Dalton et al [12,35], in which the instrument named Assessment of Physiotherapy Practice (APP) presents ICC values between 0.72 and 0.92 and evidence of construct validity provided by the Rasch analysis.…”

Section: Introductionmentioning

confidence: 99%

“…On the other hand, Dogan et al [36], propose using a rubric in the Physiotherapy practical examination, where they only analyze the degree of agreement between raters (kappa = 0.47 p<0.01) when using a rating scale by categories. In contrast, in the tool proposed by Torres-Narva ´ez et al [37], named Measurement Tool for Clinical Competencies in PT(MTCCP), content validity is analyzed using the Content Validity Index (CVI >0. 8), internal consistency using Cronbach's alpha coefficient = 0.982 and construct validity using an exploratory factor analysis, in which the Kaiser-Meyer-Olkin values were acceptable (KMO>.8).…”

Section: Introductionmentioning

confidence: 99%

Competence assessment rubric in the Physiotherapy Practicum

et al. 2022

View full text Add to dashboard Cite

Introduction Competence-based learning must be integrated into the practical development of Physiotherapy. Teamwork, interpersonal relations, analytical skills or critical/clinical thinking are some examples of internationally recommended competences in this kind of university studies. Therefore, there is a need to evaluate this learning in Physiotherapy through valid tools that facilitate this task. Objective To analyze the psychometric properties according to competences in Clinical Practices (RECOPC-FIS II) in order to assess 14 transversal or universal competences of under-graduate students in the Physiotherapy degree. Methods A validation study was conducted with 197 students in the 3rd and 4th year of the Physiotherapy degree and 202 clinical tutors who assessed these students using the RECOPC-FIS II. Different psychometric properties were analyzed: factor structure, internal consistency and sensitivity to change. Results The RECOPC-FIS II has a high internal consistency. Its 14 items saturate in a single factor. Regarding the sensitivity to change, the rubric showed higher scores in the Practicum of the 4th year with respect to that of the 3rd year, reaching significant differences in all of them. Conclusion The RECOPC-FIS II is a valid and reliable instrument to assess the transversal competencies of undergraduate students of Physiotherapy during their clinical practice. Therefore, it is intended to facilitate the acquisition of essential skills for the development of their professional career. The flexibility of this tool would allow its adaptation to other health science courses.

show abstract

“…Nesta análise, os critérios para permanência de uma questão foram os mesmos propostos pela literatura, de 80% de concordância entre os especialistas. Diversos autores que desenvolveram instrumentos utilizaram esses parâmetros avaliativos (35,43,44) . Assim sendo, as questões com médias inferiores foram reestruturadas ou eliminadas (35) .…”

Section: Discussão Discussãounclassified

Desenvolvimento de um instrumento de avaliação do conhecimento que o paciente com cirrose hepática tem sobre sua doença

Stelmach¹

View full text Add to dashboard Cite

Stelmach M. Development of an instrument to evaluate the knowledge of the patient with liver cirrhosis on his disease [dissertation]. São Paulo: "Faculdade de Medicina, Universidade de São Paulo"; 2019. INTRODUCTION: The application of measurement instruments is a strategy to evaluate the patient's knowledge about the disease. When carrying out an evaluation, it is possible to verify the patient understands and his/her knowledge about his/her liver cirrhosis, in order to, from this information, elaborate assertive therapeutic plans for each patient's need. This study aims to build an instrument that evaluates the patient's knowledge about liver cirrhosis. METHOD: This study includes three phases. The first one was the construction of the instrument based on a literature review. The questions were distributed in topics according to the content considered relevant to be understood and worked out during the patient's education: signs and symptoms, diagnosis, treatment and medications.In the second phase, five experts were invited to participate in the evaluation of the instrument, to check the validity of the content. Quantitative and qualitative analyzes were made. The tool used for the quantitative analysis was the CVI (Content Validity Index) and for the qualitative analysis it was used the semantic study of the questions. The third phase was the process of the restructuring the instrument, therefore, questions have been added, deleted or reworked (based on results obtained in the CVI). RESULTS: The final version of the instrument consisted of 36 questions. The instrument was evaluated in 91.7 by the average CVI and 94.4% by the universal CVI. The main suggestion indicated from the semantic study was the use of a simpler language and accessible to the target public.CONCLUSION: The questions are properly structured and clear, therefore, understandable. Thus, the final instrument presented satisfactory content validity, so that, it reached the aim of this study.

show abstract

Validity and reproducibility of a tool for assessing clinical competencies in physical therapy students

Cited by 15 publications

References 28 publications

Students’ Perceptions of Instructional Rubrics in Neurological Physical Therapy and Their Effects on Students’ Engagement and Course Satisfaction

Students’ Perceptions of Instructional Rubrics in Neurological Physical Therapy and Their Effects on Students’ Engagement and Course Satisfaction

Competence assessment rubric in the Physiotherapy Practicum

Desenvolvimento de um instrumento de avaliação do conhecimento que o paciente com cirrose hepática tem sobre sua doença

Contact Info

Product

Resources

About