New Medical Licensing Examination Using Computer-based Case Simulations and Standardized Patients

Guagnano, Maria Teresa; Merlitti, D.; Manigrasso, Maria Rosaria; Pace‐Palitti, V.; Sensi, S

doi:10.1097/00001888-200201000-00020

Cited by 14 publications

(18 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Over recent years, we have seen an increasing level of use of simulated and virtual patients (computer-based simulations of patients) for both training and assessment in medical education (Cantillon et al 2004;Guagnano et al 2002). This has been extensively reported by Issenberg et al (2005) in a BEME systematic review (guide no 4) where both problems and opportunities were thoroughly investigated.…”

Section: Introductionmentioning

confidence: 98%

The use of a virtual patient case in an OSCE-based exam – A pilot study

et al. 2008

View full text Add to dashboard Cite

Background: This study focuses on a skills test based clinical assessment where 118 fourth-year medical students at the four teaching hospitals of Karolinska Institutet participated in the same 12-module OSCE. The goal of one of the twelve examination modules was to assess the students' skills and ability to solve a virtual patient (VP) case (the ISP system), which included medical history taking, lab tests, physical examinations and suggestion of a preliminary diagnosis. Aims: The primary aim of this study was to evaluate the potential of a VP as a possible tool for assessment of clinical reasoning and problem solving ability among medical students. The feeling of realism of the VP and its possible affective impact on the student's confidence were also investigated. Method: We observed and analysed students' reactions, engagement and performance (activity log files) during their interactive sessions with the simulation. An individual human assistant was provided along with the computer simulation and the videotaped interaction student/assistant was then analysed in detail and related to the students' outcomes. Results:The results indicate possible advantages of using ISP-like systems for assessment. The VP was for instance able to reliably differentiate between students' performances but some weaknesses were also identified, like a confounding influence on students' outcomes by the assistants used. Significant differences, affecting the results, were found between the students in their degree of affective response towards the system as well as the perceived usefulness of assistance. Conclusion: Students need to be trained beforehand in mastering the assessment tool. Rating compliance needs to be targeted before VP-based systems like ISP can be used in exams and if such systems would be used in high-stake exams, the use of human assistants should be limited and scoring rubrics validated (and preferably automated).

show abstract

Section: Introductionmentioning

confidence: 98%

The use of a virtual patient case in an OSCE-based exam – A pilot study

et al. 2008

View full text Add to dashboard Cite

show abstract

“…Although CCT was not predictive of SP scores, it was related to working experience and enabled more valid performance assessment. Guagnano et al (2002) from the University G. D'Annunzio, Italy, enrolled medical school graduates in an examination that combined computer-based case simulations and clinical encounters using standardized patients and as a third the exam scores students obtained during medical school. There were moderate correlations between all three items.…”

Section: Relationship To Other Variablesmentioning

confidence: 99%

“…Similar to the approach of Guagnano et al (2002) in this study results from the normal curriculum were used for validation of the new assessment format. Correlation analysis was performed with the scores of the online assessment and the results of the written exam at the end of the General Practice course.…”

Section: Relationship To Other Variablesmentioning

confidence: 99%

Virtual patients for assessing medical students–important aspects when considering the introduction of a new assessment format

2008

View full text Add to dashboard Cite

Although a direct comparison of written course exams and dealing with virtual patients is difficult in many aspects and the study setting as an exam simulation caused confounders, this new assessment format is supported by many aspects of validity evidence. Solving virtual clinical scenarios addresses other abilities, skills and knowledge than traditional written exams and since "assessment drives learning" it could have positive implications on teaching and learning alike.

show abstract

“…Frequently, the encounters are observed and videotaped to protect the SP and the person being evaluated. SPs are widely used in training medical students and physicians in training, and for continuing medical education experiences (Guagnano, Merlitti, Manigrasso, Pace-Palitti, & Sensi, 2002). The SP examinations are most effective to evaluate the following competencies: workup/assessment of a client (medical, social, emotional, or other history, physical examination skills); communication skills, including giving bad news and counseling patients; and managing complex situations that could harm patients or staff when mishandled (e.g., suicidal patient, aggressive client behavior, paranoia).…”

Section: Assessment Of Skills and Tasksmentioning

confidence: 99%

Best practices for assessing competence and performance of the behavioral Health workforce

Bashook

2005

APMH

View full text Add to dashboard Cite

The need for mechanisms to assess the competence and performance of the behavioral health workforce has received increasing attention. This article reviews strategies used in general medicine and other disciplines for assessing trainees and practitioners. The possibilities and limitations of various approaches are reviewed, and the implications for behavioral health are addressed. A conceptual model of competence is presented, and practical applications of this model are reviewed. Finally, guidelines are proposed for building competency assessment protocols for behavioral health.

show abstract

New Medical Licensing Examination Using Computer-based Case Simulations and Standardized Patients

Abstract: The MIPP is a good tool for assessing clinical competence. Internationally, computer-based and standardized patient assessments are being used more often in licensing examinations. Continuous use of this method could improve medical graduates' performances.

Cited by 14 publications

References 10 publications

The use of a virtual patient case in an OSCE-based exam – A pilot study

The use of a virtual patient case in an OSCE-based exam – A pilot study

Virtual patients for assessing medical students–important aspects when considering the introduction of a new assessment format

Best practices for assessing competence and performance of the behavioral Health workforce

Contact Info

Product

Resources

About