Développement, validation et implantation d’un outil novateur critérié d’évaluation de la progression des compétences des résidents en médecine familiale

Lacasse, Miriam; Rheault, Christian; Tremblay, Isabelle; Renaud, Jean‐Sébastien; Coché, Frédéric; St‐Pierre, Annie; Théorêt, Johanne; Tessier, Sylvie; Arsenault, Louise; Simard, Marie-Lee; Simard, Caroline; Savard, Isabelle; Castel, Josette; Côté, Luc

doi:10.1051/pmed/2018007

Cited by 10 publications

(10 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…This score allows the system to propose an overall score for the assessment. The formula takes into account five variables whose values are established by the Program (Lacasse et al, 2017). Figure 6 shows the formula and specifies the values chosen by the Family Medicine Residency Program for these variables.…”

Section: Tables Of Correspondence Between Levels Of Supervision and Resultsmentioning

confidence: 99%

“…The developmental benchmarks developed and validated by Laval University's Family Medicine Program (Lacasse et al, 2014(Lacasse et al, , 2017 characterize the program expectations with respect to the development of thirty-four competencies during the two years of training. Figure 3 presents the expected timelines for developing each competency level during the residency program.…”

Section: Competencies and Benchmarks And Timelines For Their Achievementmentioning

confidence: 99%

“…From this figure, it can be seen that some competencies should be demonstrated toward the end of the residency program (e.g., Scholar 7-Teaches students and colleagues), whereas others should be shown at the beginning of the residency program (e.g., Professional 1-Adopts professional behaviours in clinical practice). The expectations were determined based on the Delphi method with a group of clinical teachers before the system was developed (Lacasse et al, 2017). During this previous study, content and convergence validities among assessors were verified.…”

Section: Competencies and Benchmarks And Timelines For Their Achievementmentioning

confidence: 99%

See 2 more Smart Citations

Development and use of a computerized system to track the competency development of family medicine residents: analysis of the convergence between system proposals and assessor decisions

Savard

Côté

Kadhi

et al. 2022

RPTEL

Self Cite

View full text Add to dashboard Cite

In recent decades, a number of training environments have moved toward program approaches targeting the development of competencies. Because of their complexity, monitoring the development of those competencies is a considerable challenge. Our hypothesis is that a computerized system could help overcome this challenge if it is well accepted by its users. We first summarize the context surrounding the implementation of such approaches. Next, we present a computerized assessment system established in the Family Medicine Residency Program of Laval University (Québec, Canada) that we have developed for tracking the development of residents’ competencies. We then present the analysis of interactions between the system and users and the various proposals that were made to improve the system and longitudinal tracking of the development of the targeted competencies. We consider that this research provides useful guidelines for the computerized monitoring of learners' competencies development and for the design of such systems.

show abstract

Section: Tables Of Correspondence Between Levels Of Supervision and Resultsmentioning

confidence: 99%

Section: Competencies and Benchmarks And Timelines For Their Achievementmentioning

confidence: 99%

Section: Competencies and Benchmarks And Timelines For Their Achievementmentioning

confidence: 99%

See 1 more Smart Citation

Development and use of a computerized system to track the competency development of family medicine residents: analysis of the convergence between system proposals and assessor decisions

Savard

Côté

Kadhi

et al. 2022

RPTEL

Self Cite

View full text Add to dashboard Cite

show abstract

“…Université Laval is one of three francophone faculties of medicine in the province of Quebec, Canada. Its family medicine residency program developed an innovative electronic tool, the criterion-based Competency Assessment Tool (CAT ; Lacasse et al, 2017), in response to the new physician competency framework established by the Royal College of Physicians and Surgeons of Canada and the College of Family Physicians of Canada, namely the CanMEDS (Frank, Snell and Sherbino, 2015). This tool is based on rubrics that represent program expectations with regard to achievement of various CanMEDS-MF competencies in the course of residency and specifies the time intervals for each supervision level (or independence level).…”

Section: The Current Studymentioning

confidence: 99%

CanMEDS Competencies in Family Medicine Residents: Can Criterion-Based Assessment Improve the Quality of Teacher Feedback?

Simard¹,

Côté²,

Bruyn³

et al. 2021

MedEdPublish

Self Cite

View full text Add to dashboard Cite

Background:The Université Laval family medicine program has developed an innovative computerized tool called the criterion-based Competency Assessment Tool (CAT), currently undergoing validity assessment. Methods:This study followed a qualitative design assessing written comments collected in the assessment reports from the cohorts before and after the implementation of the CAT (n pre = 200, n post = 200) in order to ascertain the tool's consequence validity. A deductive thematic content analysis was performed and pre-and post-implementation cohorts were compared.Findings: Overall feedback quality does not appear to have changed between cohorts. When analyzing CanMEDS roles separately, each is covered more often, but related comments appear to be less specific. The new report also seems to enable the teacher to tell more with the same number of words.Conclusions: Perhaps since the items are complete, exhaustive, and detailed enough to be self-explanatory, the tool helps the teacher to cover a wider area of competencies without the need to add many details with narrative comments. Consequence validity does not seem to have been substantially affected by changes in the family medicine resident's competency assessment, but the results do not support the contention that comment quality has improved either.

show abstract

“…Du côté des besoins prescrits, le Guide a été conçu en respectant les recommandations des auteurs consultés. Plus spécifiquement, il rend explicites les attentes à différents niveaux de formation adaptés de la littérature et validés par consensus entre les différentes universités participant au projet, 28,[41][42][43][44][45][46][47][48] cible des comportements observables, et ne limite pas la rétroaction à une échelle quantitative. 16 De plus, il respecte les besoins exprimés, notamment l'importance d'un format narratif guidé tant pour les superviseurs que pour les résidents, conservant le vocabulaire CanMEDs et les étapes de l'entrevue médicale comme cadres de référence, de manière adaptée au niveau de formation du résident.…”

Section: Phase 2 -éLaboration Du Guideunclassified

Développement et mise à l’essai du Guide de rétroaction francophone pour l’observation directe des résidents en médecine familiale au Canada

Lacasse

Renaud²,

Côté³

et al. 2021

Can. Med. Ed. J

Self Cite

View full text Add to dashboard Cite

Résumé Contexte : Il n’existe aucun outil par jalons reposant sur les CanMEDS-MF pour guider la rétroaction en supervision par observation directe (SPOD). Nous avons développé un guide pour soutenir la documentation de la rétroaction en SPOD en médecine familiale (MF) au Canada. Méthode : La conception du Guide a été effectuée en trois phases avec la collaboration de cinq programmes de MF canadiens ayant minimalement un site d’enseignement francophone : 1) recension des écrits et étude des besoins; 2) élaboration du Guide de rétroaction SPOD; 3) mise à l’essai du Guide en contexte de simulation vidéo avec analyse de contenu qualitative. Résultats : La phase 1 a démontré le besoin d’un guide narratif ayant pour but 1) de préciser les attentes mutuelles selon le niveau de formation du résident et le contexte clinique, 2) d’outiller et structurer le superviseur dans ses observations 3) de faciliter la documentation de la rétroaction. La phase 2 a permis d’élaborer le Guide, en formats papier et électronique, répondant aux besoins identifiés. En phase 3, 15 superviseurs ont utilisé le guide pour trois niveaux de résidence. Le Guide a été ajusté à la suite de cette mise à l’essai pour rappeler les phases de la rencontre clinique souvent oubliées durant la rétroaction (avant la consultation, diagnostic et suivi), et y suggérer des types de formulation à favoriser (questions stimulantes, questions de clarification, réflexions). Conclusion : Issu de données probantes et d’une démarche de concertation, ce Guide outillera les superviseurs et résidents francophones canadiens dans leurs activités de SPOD en médecine familiale.

show abstract

Développement, validation et implantation d’un outil novateur critérié d’évaluation de la progression des compétences des résidents en médecine familiale

Cited by 10 publications

References 29 publications

Development and use of a computerized system to track the competency development of family medicine residents: analysis of the convergence between system proposals and assessor decisions

Development and use of a computerized system to track the competency development of family medicine residents: analysis of the convergence between system proposals and assessor decisions

CanMEDS Competencies in Family Medicine Residents: Can Criterion-Based Assessment Improve the Quality of Teacher Feedback?

Développement et mise à l’essai du Guide de rétroaction francophone pour l’observation directe des résidents en médecine familiale au Canada

Contact Info

Product

Resources

About