Desempeño del examen clínico objetivo estructurado como instrumento de evaluación en la certificación nacional como reumatólogo

Ramos, Virginia Pascual; Ramírez, Gabriel Medrano; Vallejo, Eunice Solís; Medina, A.G. Bernard; Alvarado, D. E. Flores; Hernández, Margarita Portela; Ortega, Lilia Andrade; Vera‐Lastra, Olga; Morales, Rolando Espinosa; Limón, Juan Manuel Miranda; Velázquez, María del Rocío Maldonado; Quezada, Luis Javier Jara; Guerra, Luis Manuel; Zepeda, Judith López; Salinas, Miguel Ángel Saavedra; Salinas, César Alejandro Arce

doi:10.1016/j.reuma.2014.10.007

Cited by 16 publications

(6 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…One study at low risk of bias demonstrated that a rheumatology OSCE including a mix of clinical, laboratory and imaging stations showed a good to very good internal consistency (Cronbach's α=0.83-0.92), intrarater reliability (correlation coefficient=0.80-0.95) and construct validity. 12 A fair to moderate correlation (r=0.44-0.52) between OSCEs and other assessment tools, including DOPS, rating by programme directors and written exam was also found. 12-14 16 In the specific ultrasound OSCE, the assessment of normal joint more reliably discriminated examinees from the ultrasonography experts (control population) than the evaluation of pathologic joints; inter-rater reliability was also better for normal joint assessment stations.…”

Section: Assessment Of Competences In Rheumatologymentioning

confidence: 79%

“…The five eligible studies on the assessment of competences in rheumatology were at variable risk of bias (two low, two unclear and one high) and explored only two methods: DOPS (one study) and OSCE (four studies) [12][13][14][15][16] (table 2). Rheumatology OSCEs have been used to assess clinical skills, [12][13][14] communication, 13 professionalism 13 and practical skills on musculoskeletal ultrasound. 15 In particular, the latter included stations with healthy subjects and patients with rheumatic diseases and trainees were blinded on whether the joint to be examined was abnormal or normal.…”

Section: Assessment Of Competences In Rheumatologymentioning

confidence: 99%

“…†Rated with the ambulatory clinic evaluation form. ‡The range of the study12 indicates the values across the stations repeated in the 2 academic years.DOPS, direct observation of practical skills; ICC, intraclass correlation coefficient; MCQ, multiple-choice questionnaire; MERSQI, Medical Education Research Study Quality Instrument; MSUS, musculoskeletal ultrasound; NA, not available; OSCE, objective structured clinical examination. explored different methods, including OSCE, DOPS, multisource feedback, mini-clinical evaluation exercise and patient satisfaction questionnaires.…”

mentioning

confidence: 99%

See 2 more Smart Citations

Assessment of competences in rheumatology training: results of a systematic literature review to inform EULAR points to consider

et al. 2020

View full text Add to dashboard Cite

ObjectiveTo summarise the literature on the assessment of competences in postgraduate medical training.MethodsA systematic literature review was performed within a EULAR taskforce on the assessment of competences in rheumatology training and other related specialities (July 2019). Two searches were performed: one search for rheumatology and one for related medical specialities. Two reviewers independently identified eligible studies and extracted data on assessment methods. Risk of bias was assessed using the medical education research study quality instrument.ResultsOf 7335 articles in rheumatology and 2324 reviews in other specialities, 5 and 31 original studies were included, respectively. Studies in rheumatology were at variable risk of bias and explored only direct observation of practical skills (DOPS) and objective structured clinical examinations (OSCEs). OSCEs, including clinical, laboratory and imaging stations, performed best, with a good to very good internal consistency (Cronbach’s α=0.83–0.92), and intrarater reliability (r=0.80–0.95). OSCEs moderately correlated with other assessment tools: r=0.48 vs rating by programme directors; r=0.2–0.44 vs multiple-choice questionnaires; r=0.48 vs DOPS. In other specialities, OSCEs on clinical skills had a good to very good inter-rater reliability and OSCEs on communication skills demonstrated a good to very good internal consistency. Multisource feedback and the mini-clinical evaluation exercise showed good feasibility and internal consistency (reliability), but other data on validity and reliability were conflicting.ConclusionDespite consistent data on competence assessment in other specialities, evidence in rheumatology is scarce and conflicting. Overall, OSCEs seem an appropriate tool to assess the competence of clinical skills and correlate well with other assessment strategies. DOPS, multisource feedback and the mini-clinical evaluation exercise are feasible alternatives.

show abstract

Section: Assessment Of Competences In Rheumatologymentioning

confidence: 79%

Section: Assessment Of Competences In Rheumatologymentioning

confidence: 99%

mentioning

confidence: 99%

See 1 more Smart Citation

Assessment of competences in rheumatology training: results of a systematic literature review to inform EULAR points to consider

et al. 2020

View full text Add to dashboard Cite

show abstract

“…In fact, the correlation between scores from assessment tools evaluating different competences is very weak. [20][21][22][23][24] On the other hand, different assessment methods can be used to assess a single competence, providing complementary information. For instance, the ability to aspirate a joint can be assessed with a mannequin (simulation) or on a real person with an RMD (eg, workplace-based via direct observation of procedural skills (DOPS)).…”

Section: Objective Structured Clinical Evaluation (Osce)mentioning

confidence: 99%

2019 EULAR points to consider for the assessment of competences in rheumatology specialty training

et al. 2020

View full text Add to dashboard Cite

Background and aimStriving for harmonisation of specialty training and excellence of care in rheumatology, the European League Against Rheumatism (EULAR) established a task force to develop points to consider (PtCs) for the assessment of competences during rheumatology specialty training.MethodsA systematic literature review on the performance of methods for the assessment of competences in rheumatology specialty training was conducted. This was followed by focus groups in five selected countries to gather information on assessment practices and priorities. Combining the collected evidence with expert opinion, the PtCs were formulated by the multidisciplinary task force, including rheumatologists, medical educationalists, and people with rheumatic and musculoskeletal diseases. The level of agreement (LoA) for each PtC was anonymously voted online.ResultsFour overarching principles and 10 PtCs were formulated. The overarching principles highlighted the importance of assessments being closely linked to the rheumatology training programme and protecting sufficient time and resources to ensure effective implementation. In the PtCs, two were related to overall assessment strategy (PtCs 1 and 5); three focused on formative assessment and portfolio (PtCs 2–4); three focused on the assessment of knowledge, skills or professionalism (PtCs 6–8); one focused on trainees at risk of failure (PtC 9); and one focused on training the trainers (PtC 10). The LoA (0–10) ranged from 8.75 to 9.9.ConclusionThese EULAR PtCs provide European guidance on assessment methods throughout rheumatology training programmes. These can be used to benchmark current practices and to develop future strategies, thereby fostering continuous improvement in rheumatology learning and, ultimately, in patient care.

show abstract

“…De acuerdo con este Consejo, el ECOE mostró una sólida fiabilidad para ser integrado como parte de la evaluación para las competencias de los médicos especialistas en reumatología. 12,13 El ECOE fue publicado por Harden en 1975 como una innovadora herramienta de evaluación clínica para estudiantes de medicina, la cual, a 48 años de distancia sigue siendo efectiva para la evaluación del aprendizaje en la práctica clínica mediante escenarios estandarizados en estaciones diseñadas para realizar interrogatorio; exploración f ísica; diagnóstico y tratamiento. Cada una de estas estaciones requiere de un evaluador y pacientes estandarizados15, generalmente se utiliza en la rama médica, aunque, también se ha publicado su uso en otras áreas como derecho, sociología, trabajo social 14 y enfermería clínica.…”

Section: Introductionunclassified

Proceso de evaluación de la competencia clínica en la certificación de especialistas en medicina familiar a través de un ECOE en línea

Fernández-Ortega,

Hernández-Martínez,

Portillo García

et al. 2023

AMF

View full text Add to dashboard Cite

Objetivo: Realizar la fase práctica del Examen de Certificación de Medicina Familiar a 860 aspirantes en México a través de un Examen Clínico Objetivo Estructurado (ECOE) en línea. Métodos: El ECOE en línea se efectuó del mes de enero de 2022 a julio de 2023. Para el desarrollo de esta estrategia de evaluación fue necesario implementar tareas en los siguientes procesos: I. Desarrollo de la rúbrica y diseño de estaciones; 2. Capacitación de los académicos, evaluadores (sinodales), sustentantes, pacientes estandarizados y personal de tecnologías de la información y la comunicación; 3. Infraestructura, tecnología y convocatoria de registro. Resultados y Conclusiones. El ECOE en línea es una alternativa viable para evaluar las competencias profesionales de los especialistas que se certifican por los Consejos de Certificación. Es útil en escenarios remotos, sobre todo en los que presenta la dispersión geográfica de México. Es factible aplicarlo a un alto número de sustentantes, reduce la movilidad de los evaluados y los costos de bolsillo que tienen que realizar derivados de su transportación.

show abstract

Desempeño del examen clínico objetivo estructurado como instrumento de evaluación en la certificación nacional como reumatólogo

Cited by 16 publications

References 16 publications

Assessment of competences in rheumatology training: results of a systematic literature review to inform EULAR points to consider

Assessment of competences in rheumatology training: results of a systematic literature review to inform EULAR points to consider

2019 EULAR points to consider for the assessment of competences in rheumatology specialty training

Proceso de evaluación de la competencia clínica en la certificación de especialistas en medicina familiar a través de un ECOE en línea

Contact Info

Product

Resources

About