Development and Implementation of an Objective Structured Clinical Examination (OSCE) in Neuromuscular Physical Therapy

Gorman, Sharon L.; Lazaro, Rolando T.; Fairchild, Judith; Kennedy, Bret

doi:10.1097/00001416-201007000-00008

Cited by 14 publications

(73 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…From the six included studies, two were conducted in Canada [ 20 , 21 ], one in Brazil [ 22 ], one in Australia [ 23 ] and two were conducted in the USA [ 6 , 18 , 19 ]. All studies were conducted in a university research unit.…”

Section: Resultsmentioning

confidence: 99%

“…The mean number of participants across studies was 47, with a minimum of 16 and a maximum at 66 participants. Three studies used data from real world examinations (observational) [ 6 , 18 – 20 ] and three designed a simulated examination to fit the purposes of the study (experimental [ 21 – 23 ]. None of the studies was conducted for licensure purpose [ 6 , 19 – 23 ].…”

Section: Resultsmentioning

confidence: 99%

“…One study used a nine-station format [ 21 ]. Two studies included eight stations per participant [ 6 , 20 ] and the rest of them included seven [ 18 ], six [ 19 ] and five [ 22 ] stations. One study used a single station OSCE format [ 23 ].…”

Section: Resultsmentioning

confidence: 99%

“…Alternatively, simulations can be used, but may lack generalizability since the context and weight of the decision are not replicated. Another challenge is that OSCEs can vary in terms of the number of stations, observation times and numbers or training of assessors, and the structure can vary across different professions [ 6 ]. Thus, some variation in test performance may be related to the variations in the ways that the tests are constructed.…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

A systematic review and meta-analysis of measurement properties of objective structured clinical examinations used in physical therapy licensure and a structured review of licensure practices in countries with well-developed regulation systems

et al. 2021

View full text Add to dashboard Cite

Background The Objective Structured Clinical Examination (OSCE) is a commonly used tool internationally to assess clinical competency. Physical therapy (PT) licensure processes vary internationally. The OSCE is the tool used in Canada to assess clinical competency for PT graduates seeking licensure. Previous studies that examined the measurement properties of OSCEs present contradictory results. Objectives The first objective was to investigate the reliability and validity of OSCEs when administered to PTs during their education or as part of a licensure process. The second objective was to conduct a structured review to report PT educational and licensing components and policies in 17 countries with well-developed PT regulation systems. Methods An electronic search was performed in four databases from inception to 31st March 2021 to identify relevant articles. Two reviewers performed the critical appraisal of the included studies using a validated quality assessment tool. We deployed a random effects meta-analysis on reliability and validity estimates of OSCEs and examined sources of heterogeneity with univariate meta-regressions. We searched websites of professional regulatory bodies and associations for data on educational and licencing components and policies. Educational and licensing components across countries were synthesized descriptively. Results A pooled estimate of Cronbach’s alpha of 0.55, (95% CI: 0.41, 0.67) was determined for OSCEs. The pooled estimate of Intraclass Correlation Coefficient (ICC) between assessors was 0.77 (95% CI: 0.70, 0.83). The pooled estimate of Pearson Correlation between multiple OSCE stations’ scores was 0.27 (95% CI: 0.15, 0.39); and between each station score and the total score was 0.71 (95% CI: 0.61, 0.79). The pooled estimates for kappa Coefficients were 0.75 (95% CI: 0.58, 0.86) and 0.84, (95% CI: 0.72, 0.91) for intra-rater and inter-rater reliability of the standardised patient respectively. From the 17 included countries, Canada (excluding Quebec) was the only country that required both a clinical and written competency exam following graduation from an accredited PT program. Two countries (USA, UAE) required a written competency exam. The remaining 14 countries did not require an additional competency examination after completion of degree requirements from an accredited program. Conclusions We found weak evidence that OSCE examinations items are internally consistent when used to assess PTs. Canada (excluding Quebec) is the only country out of 17 implementing a national clinical competency examination for their PT graduates to achieve licensure after completing professional degree requirements.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Resultsmentioning

confidence: 99%

Section: Resultsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

A systematic review and meta-analysis of measurement properties of objective structured clinical examinations used in physical therapy licensure and a structured review of licensure practices in countries with well-developed regulation systems

et al. 2021

View full text Add to dashboard Cite

show abstract

“…The validity and reliability of simulated patients in assessing clinical competence has been investigated in physiotherapy with 'promising' yet inconclusive results (Panzarella & Manyon 2008). Although an Objective Structured Clinical Examination using simulated patients is feasible and correlates with physiotherapy students' final course grades (Gorman et al 2010), simulated patients require developed scripts and characters, lengthy training and reimbursement. When faced with unique situations (e.g., questions not covered in training), standardised patients are not necessarily able to respond to these spontaneous teaching moments in an authentic and realistic manner.…”

Section: Introductionmentioning

confidence: 99%

Study Protocol: MASK-ED™ (KRS Simulation) - impact on physiotherapy student performance

Ryall

Preston

Mahendran

et al. 2020

HEPJ

View full text Add to dashboard Cite

Purpose: MASK-ED™ (KRS Simulation) involves an educator donning a silicone mask to portray a patient character that has been specifically developed in line with learning outcomes. The effectiveness of MASK-ED™ (KRS Simulation to prepare physiotherapy students prior to commencing work integrated learning has not been investigated.Methodology: This randomised cluster trial will investigate MASK-ED™ (KRS Simulation) in addition to usual teaching in neurological physiotherapy. Physiotherapy students in an intervention group will receive simulated learning via a MASK-ED™ (KRS Simulation) character as well as usual teaching. Students in a control group will receive usual teaching only, including role-play with peers. Consent will be concealed from the investigating team and blinded assessors will assess the primary outcome. Secondary outcomes will be practical and written examination results and a satisfaction survey.Research implications: This will be the first randomised trial investigating MASK-ED™ (KRS Simulation)’s effect on students’ readiness for work integrated learning.Practical implications: The results from this study will inform physiotherapy education and curriculum development by increasing the evidence base for the use of simulation in training physiotherapy students prior to work integrated learning.Originality: MASK-ED™ (KRS Simulation) was developed in nursing education at Central Queensland University, Australia. Although it has been investigated in medical imaging, this is its first practical application within physiotherapy curricula.Limitations: It will be impractical and unfeasible to blind the participants and the investigators to tutorial group allocation and impractical for blind assessing of practical examinations.

show abstract

Development and validation of a direct observation of procedural skills for knee joint mobilization

Hou¹,

Yu²,

Lin³

2023

AIP Conference Proceedings

View full text Add to dashboard Cite

Development and Implementation of an Objective Structured Clinical Examination (OSCE) in Neuromuscular Physical Therapy

Cited by 14 publications

References 13 publications

A systematic review and meta-analysis of measurement properties of objective structured clinical examinations used in physical therapy licensure and a structured review of licensure practices in countries with well-developed regulation systems

A systematic review and meta-analysis of measurement properties of objective structured clinical examinations used in physical therapy licensure and a structured review of licensure practices in countries with well-developed regulation systems

Study Protocol: MASK-ED™ (KRS Simulation) - impact on physiotherapy student performance

Development and validation of a direct observation of procedural skills for knee joint mobilization

Contact Info

Product

Resources

About