On line clinical reasoning assessment with Script Concordance test in urology: results of a French pilot study

Sibert, L.; Darmoni, Stéfan Jacques; Dahamna, Badisse; Hellot, Marie‐France; Wéber, Jacques; Charlin, Bernard

doi:10.1186/1472-6920-6-45

Cited by 53 publications

(47 citation statements)

References 24 publications

(52 reference statements)

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Although the present study is limited in several ways, our results are well correlated with other studies on Concordance test which have previously demonstrated the validity and the reliability on the Concordance test in different medical specialties (Brailovsky et al 2001;Charlin et al 2002;Charlin & Van der Vleuten 2004;Gagnon et al 2006;Sibert et al 2006b;Charlin et al 2007;Meterissian et al 2007). Sample size of participants was comparable or greater than those reported in the literature.…”

Section: Discussionsupporting

confidence: 80%

“…The evaluation system can be assessed via any computer system with a standard Web browser. Contrary to the Concordance test in urology, which was limited to French urologists (Sibert et al 2006b), the concordance test in therapeutics was open to any members of the APNET and any students or trainees from medical schools members of the FMVU consortium. The home page of the test (Figure 1) (Sibert et al 2006), most of the participants primarily came from 'Ile de France' area (N ¼ 125) and from 'Normandy' geographical area (N ¼ 75); the other participants (N ¼ 51) came from various French areas.…”

Section: Resultsmentioning

confidence: 99%

“…We have recently introduced a Web-based Concordance test in the field of urology. To our knowledge, this study was the first reported Web-based assessment course with the concordance test (Sibert et al 2006b). This process adheres to the main principles of practical guidelines for developing an effective educational website (Cook & Dupras 2004) and is based on the traditional three-tier architecture used in Web database applications.…”

Section: Development Of the Web Sitementioning

confidence: 99%

See 2 more Smart Citations

Is a web-based concordance test feasible to assess therapeutic decision-making skills in a French context?

Sibert¹,

Giorgi²,

Dahamna³

et al. 2009

Medical Teacher

Self Cite

View full text Add to dashboard Cite

Background: At the end of undergraduate medical curriculum, a written simulation-based examination is used in France to assess therapeutic decision-making skills and to rank students for the purpose of matching their training specialties. However, this examination based on a single assessment method remains a subject of debate. Aim: To study the feasibility of a web-based Concordance test for therapeutic decision-making assessment. Methods: A 12 clinical-case Concordance test was developed based on objectives for the undergraduate training program. The test was administered on line to candidates with different levels of clinical experience. Fifteen therapeutic teachers constituted the reference panel. Data analysis included analysis of variance, post-hoc test, and Cronbach's alpha. Results: One hundred and seventy participants (113 students, 34 residents, 23 physicians) fully completed the free-access test on line with no technical problems. Differences between the mean scores for groups were significant ( p < 0.001). Significant differences occurred between fourth year students and residents ( p < 0.001), fourth year students and physicians ( p ¼ 0.001). No difference was found between residents and physicians. Reliability coefficient was 0.67. Conclusion: A web-based Concordance test in the field of therapeutic decision-making was considered feasible in a French learning environment. Further research is warranted to determine its usefulness as a part of the National Examination.

show abstract

Section: Discussionsupporting

confidence: 80%

Section: Resultsmentioning

confidence: 99%

Section: Development Of the Web Sitementioning

confidence: 99%

See 1 more Smart Citation

Is a web-based concordance test feasible to assess therapeutic decision-making skills in a French context?

Sibert¹,

Giorgi²,

Dahamna³

et al. 2009

Medical Teacher

Self Cite

View full text Add to dashboard Cite

show abstract

“…4 The instrument has been developed in various educational settings and in different countries and languages and is based on written presentation of short clinical cases, followed by a choice of diagnostic and therapeutic decisions. 1,[5][6][7][8][9][10][11][12][13] Routine use of the SCT is not common in Brazilian universities.…”

Section: Introductionmentioning

confidence: 99%

Script concordance test in medical schools in Brazil: possibilities and limitations

Roberti

Pereira

et al. 2016

Sao Paulo Med. J.

View full text Add to dashboard Cite

CONTEXT AND OBJECTIVE: Routine use of the script concordance test (SCT) is not common in Brazilian universities. This study aimed to analyze application of the SCT in the medical school of a Brazilian university. DESIGN AND SETTING: Quantitative, analytical and descriptive study in the medical school of a Brazilian university. METHODS: A total of 159/550 students participated. The test comprised ten clinical cases within internal medicine, with five items per case, rated on a five-point Likert scale. The test was scored in accordance with a marking key that had been validated by a reference panel. RESULTS:In the pre-clinical and clinical phases, the mean scores were 51.6% and 63.4% of the maximum possible scores, respectively. Comparison of the means of the responses among all the years showed that there were significant differences in 40% of the items. The panel marked all the possible answers in five items, while in one item, all the panelists marked a single answer. Cronbach's alpha was 0.64. The results indicated that the more senior students performed better. Construction of an SCT with discriminative questions was not easy. The low reliability index may have occurred due to: a) problems with the construction of the questions; b) limitations of the reference panel; and/or c) the scoring key. CONCLUSION:This instrument is very difficult to construct, apply and correct. These difficulties may make application of an SCT as an assessment method unfeasible in units with limited resources. RESUMO

show abstract

“…On a notamment pu mettre en évidence une progression des scores selon qu'il est administré respectivement à des étudiants en méde-cine, à des internes et à des praticiens expérimen-tés [4][5][6][7][8] . Les modalités techniques de construction et d'administration d'un test sont également bien connues [9][10][11][12][13][14] .…”

Section: Introductionunclassified

Utilisation du test de concordance de script au cours du deuxième cycle des études médicales : expérience dans l’enseignement de la neurochirurgie

2011

View full text Add to dashboard Cite

Manuscrit reçu le 12 février 2011 ; commentaires éditoriaux formulés aux auteurs le 30 mars 2011 ; accepté pour publication le 28 avril 2011 Mots clés :Test de concordance de script ; deuxième cycle des études médicales ; raisonnement clinique ; neurochirurgie Résumé -Contexte. Le test de concordance de script, largement diffusé en troisième cycle et en formation médicale continue, n'est en revanche pas utilisé au cours du deuxième cycle des études médicales. Objectifs. Le but de ce travail est d'évaluer si le test de concordance de script peut être utilisé pour classer les étudiants en formation initiale de médecine. Matériel et méthodes. Un test constitué de trente items de neurochirurgie est soumis à 75 étudiants à l'issue d'un stage hospitalier de neurochirurgie (43 étudiants de deuxième année -DCEM2 -, 20 de troisième année -DCEM3 -et 12 de quatrième année -DCEM4 -du deuxième cycle des études médicales). Résultats. Les scores moyens (sur 100 points) étaient de 51,84 ± 8,22, 54,94 ± 7,30 et 59,78 ± 6,08 respectivement pour les trois groupes d'étudiants. L'analyse de variance mettait en évidence une différence globalement significative entre les groupes (p = 0,0076). Les tests post-hoc réalisés avec le test t de Student n'ont mis en évidence qu'une différence significative 2 à 2 entre les groupes DCEM2 vs. DCEM4 (p = 0,003). Conclusion. Nos résultats suggèrent que le test de concordance de script peut montrer une progression des capacités de raisonnement clinique au cours du deuxième cycle. Cela pose la question de son utilisation éventuelle dans le cadre des épreuves classantes nationales françaises. Keywords:Script concordance test; medical students; clinical reasoning; neurosurgery Abstract -Background. Script concordance tests are widely used to assess clinical reasoning among residents and senior physicians, but not among medical students. Objective. The aim of this study was to determine if script concordance tests can be used to rank students during their initial medical training. Materials and methods. A 30-item test was completed by a group of 75 medical students (43 fourth-, 20 fifth-and 12 sixth-year students) at the end of a training clerkship. Results. The mean scores were respectively: 51. 84±8.22, 54.94±7.30 and Article publié par EDP Sciences 59.78 ± 6.08. The variance analysis identified a significant overall difference between groups (p = 0.0076). Post-hoc student t-tests, using the Bonferroni correction to assess significance (p < 0.017), identified only one difference between the DCEM2 and DCEM4 groups (p = 0.003). Conclusion. Our data suggest that script concordance tests could be used to assess the acquisition of clinical reasoning among fourth-to sixth-year medical students. If our results are confirmed by other studies, script concordance tests could be considered for the French final national ranking examination.

show abstract

On line clinical reasoning assessment with Script Concordance test in urology: results of a French pilot study

Cited by 53 publications

References 24 publications

Is a web-based concordance test feasible to assess therapeutic decision-making skills in a French context?

Is a web-based concordance test feasible to assess therapeutic decision-making skills in a French context?

Script concordance test in medical schools in Brazil: possibilities and limitations

Utilisation du test de concordance de script au cours du deuxième cycle des études médicales : expérience dans l’enseignement de la neurochirurgie

Contact Info

Product

Resources

About