Acceptance and validity of the methods used to implement a competency based medical education programme in an Intensive Care Department of a teaching referral center

Castellanos-Ortega, Álvaro; Broch, Marianne; Barrios, Mariano Sánchez; Fuentes-Dura, M.C.; Sancerni-Beitia, María-Dolores; Vicent, C.; Gimeno, Ricardo; Ramírez, Patricia; Mur-Pérez, Francisco; Ros, Rafael García

doi:10.1016/j.medine.2019.12.011

Cited by 2 publications

(3 citation statements)

References 41 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…This information was subsequently distributed and discussed through various face-to-face discussion groups (round 2) until a consensus was reached on the rubrics' final wording, considering as a criterion that at least 80% of the experts expressed agreement with the adequacy of the rubrics [72,73]. The students' perception of the rubrics was also considered since the face validity of assessment instruments can affect their use and acceptability [18,19,86,87]. After explaining and modeling students on how to use the rubrics, they completed an online questionnaire similar to the experts' .…”

Section: Methodsmentioning

confidence: 99%

“…Secondly, a more complex research design could have broadened the conclusions and practical implications of this work. A longitudinal study with multiple formative assessments conducted by different evaluators, which is characteristic of competence-based training [20,86,110,111], would have allowed for the assessment and monitor of learning curves for maneuvers. This would have provided a greater volume of validity indicators for the rubrics by empirically determining the progress and performance levels that students would have been achieving until the pre-specified quality standards were met [112].…”

Section: Strengths Limitations and Future Researchmentioning

confidence: 99%

See 1 more Smart Citation

Improving assessment of procedural skills in health sciences education: a validation study of a rubrics system in neurophysiotherapy

Garcia-Ros,

Ruescas-Nicolau,

Cezón-Serrano

et al. 2024

BMC Psychol

View full text Add to dashboard Cite

Background The development of procedural skills is essential in health sciences education. Rubrics can be useful for learning and assessing these skills. To this end, a set of rubrics were developed in case of neurophysiotherapy maneuvers for undergraduates. Although students found the rubrics to be valid and useful in previous courses, the analysis of the practical exam results showed the need to change them in order to improve their validity and reliability, especially when used for summative purposes. After reviewing the rubrics, this paper analyzes their validity and reliability for promoting the learning of neurophysiotherapy maneuvers and assessing the acquisition of the procedural skills they involve. Methods In this cross-sectional and psychometric study, six experts and 142 undergraduate students of a neurophysiotherapy subject from a Spanish university participated. The rubrics’ validity (content and structural) and reliability (inter-rater and internal consistency) were analyzed. The students’ scores in the subject practical exam derived from the application of the rubrics, as well as the rubrics’ criteria difficulty and discrimination indices were also determined. Results The rubrics´ content validity was found to be adequate (Content Validity Index > 0.90). These showed a unidimensional structure, and an acceptable internal consistency (α = 0.71) and inter-rater reliability (Fleiss’ ƙ=0.44, ICC = 0.94). The scores of the subject practical exam practically covered the entire range of possible theoretical scores, showing all the criterion medium-low to medium difficulty indices - except for the one related to the physical therapist position-. All the criterion exhibited adequate discrimination indices (rpbis > 0.39), as did the rubric as a whole (Ferguson’s δ = 0.86). Students highlighted the rubrics´ usefulness for learning the maneuvers, as well as their validity and reliability for formative and summative assessment. Conclusions The changed rubrics constitute a valid and reliable instrument for evaluating the execution quality of neurophysiotherapy maneuvers from a summative evaluation viewpoint. This study facilitates the development of rubrics aimed at promoting different practical skills in health-science education.

show abstract

Section: Methodsmentioning

confidence: 99%

Section: Strengths Limitations and Future Researchmentioning

confidence: 99%

Improving assessment of procedural skills in health sciences education: a validation study of a rubrics system in neurophysiotherapy

Garcia-Ros,

Ruescas-Nicolau,

Cezón-Serrano

et al. 2024

BMC Psychol

View full text Add to dashboard Cite

show abstract

“…Einarbeitungs- und Weiterbildungscurricula stellen gerade zu Beginn der ärztlichen Karriere ein wichtiges Hilfsmittel dar [ 1 ]. Sie dienen als Brücke zwischen der in der Realität noch fehlenden Alltagskompetenz und der betriebswirtschaftlichen Erwartungshaltung der Arbeitgeber.…”

Section: Introductionunclassified

Positive effects of training curriculum using the example of the interdisciplinary intensive care unit

Špaček

Prautzsch

Mehrholz

et al. 2022

Med Klin Intensivmed Notfmed

View full text Add to dashboard Cite

Die Einarbeitung von neuen ärztlichen Kollegen in Krankenhäusern ist aufgrund mannigfaltiger Aspekte wie z. B. Personalmangel und Zeitdruck für alle Beteiligten oft sehr herausfordernd. Am Beispiel der interdisziplinären Intensivstation wurden positive Effekte eines strukturierten Einarbeitungs- und Ausbildungscurriculums im Rahmen regelmäßiger Mitarbeiterbefragungen wissenschaftlich belegt. Es konnte ein statistisch signifikanter Anstieg der Zufriedenheit zu den Themen der Qualität der Einarbeitung ( p < 0,0001), der Qualität der Ausbildung ( p < 0,0001), der Vorbereitung auf Nachtdienste auf der Intensivstation ( p < 0,0001) und ebenso eine Verbesserung der allgemeinen Zufriedenheit in der Klinik ( p < 0,003) dargestellt werden. Ein solches Curriculum trägt aus diesen Gründen sowohl zur Erhöhung der Versorgungsqualität und Patientensicherheit bei als auch erhöht es die Sicherheit im medizinischen Handeln der ärztlichen Mitarbeiter.

show abstract

Acceptance and validity of the methods used to implement a competency based medical education programme in an Intensive Care Department of a teaching referral center

Cited by 2 publications

References 41 publications

Improving assessment of procedural skills in health sciences education: a validation study of a rubrics system in neurophysiotherapy

Improving assessment of procedural skills in health sciences education: a validation study of a rubrics system in neurophysiotherapy

Positive effects of training curriculum using the example of the interdisciplinary intensive care unit

Contact Info

Product

Resources

About