Predictive Validity of Certification by the American Board of Internal Medicine

Ramsey, Paul G.

doi:10.7326/0003-4819-110-9-719

Cited by 151 publications

(83 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Most of these studies dealt with the ability of the ABIM certifying examination to measure the construct of medical knowledge needed by an internal medicine physician. [1][2][3] More recently, two studies have dealt specifically with the ability of the ITE to predict outcome on the ABIM certifying examination. 4,5 Both studies demonstrated a significant correlation between the ITE and the ABIM certifying examination scores.…”

mentioning

confidence: 99%

Predicting pass rates on the american board of internal medicine certifying examination

Rollins

Martindale²,

Edmond³

et al. 1998

J Gen Intern Med

View full text Add to dashboard Cite

Our objective was to determine the ability of the internal medicine In-Training Examination (ITE) to predict pass or fail outcomes on the American Board of Internal Medicine (ABIM) certifying examination and to develop an externally validated predictive model and a simple equation that can be used by residency directors to provide probability feedback for their residency programs. We collected a study sample of 155 internal medicine residents from the three Virginia internal medicine programs and a validation sample of 64 internal medicine residents from a residency program outside Virginia. Scores from both samples were collected across three class cohorts. The Kolmogorov-Smirnov z test indicated no statistically significant difference between the distribution of scores for the two samples ( z ‫؍‬ R esidents in internal medicine must acquire competency in many content areas during their postgraduate training, including medical knowledge, clinical skills, clinical judgment, interpersonal skills, attitudes, ethics, and humanistic qualities as they apply across a vast range of content areas. 1 To assist both residents and program directors, the American College of Physicians, the Association of Professors of Medicine, and the Association of Program Directors in Internal Medicine developed the first national In-Training Examination (ITE) in internal medicine in 1988. This examination was developed to serve as an assessment tool, primarily for residents at the midpoint of training during the second postgraduate year (PGY2). The ITE enables residents and program directors to receive feedback and identify potential deficiencies before administration of the American Board of Internal Medicine (ABIM) certifying examination.The ABIM certifying examination has been the source of a variety of studies over the last decade. Most of these studies dealt with the ability of the ABIM certifying examination to measure the construct of medical knowledge needed by an internal medicine physician. 1-3 More recently, two studies have dealt specifically with the ability of the ITE to predict outcome on the ABIM certifying examination. 4,5 Both studies demonstrated a significant correlation between the ITE and the ABIM certifying examination scores. However, neither study externally validated its results. Therefore, the purpose of this study was threefold: replicate the previous studies through an alternative mode of analysis (logistic model), develop a predictive model that is validated by external data, and develop a simple equation that can be utilized by residency directors in a spreadsheet format to provide quick and easy ABIM pass/fail probability feedback. METHODSInternal medicine residency directors from the three Virginia medical schools were asked to provide ITE scores obtained during residents ' PGY2 year in 1992' PGY2 year in , 1993' PGY2 year in , and 1994, along with the ABIM pass/fail results for the corresponding classes in 1993, 1994, and 1995 who were taking the examination for the first time. The ITE scores reflect...

show abstract

mentioning

confidence: 99%

Predicting pass rates on the american board of internal medicine certifying examination

Rollins

Martindale²,

Edmond³

et al. 1998

J Gen Intern Med

View full text Add to dashboard Cite

show abstract

“…Observamos que la posibilidad de aprobar el examen era casi 3 veces mayor si el aspirante provenía de un programa acreditado por la SAP por el máximo plazo (5 años), lo cual resalta la importancia que esta actividad tiene para garantizar la calidad de la enseñanza. 8,9 No hemos encontrado estudios que exploren específicamente el aspecto relacionado con la edad y el resultado del examen de certificación. En un estudio desarrollado en Estados Unidos, donde se evalúan predictores de la capacidad profesional de médicos graduados fuera de ese país, Kanna y col. encuentran que, a menor edad de los médicos residentes, se verifican mejores calificaciones durante su residencia en medicina interna, y especulan con la posibilidad de que los mayores tuvieran destrezas fuertemente internalizadas adquiridas fuera del país, que difícilmente se adapten al estándar estadounidense.…”

Section: Resultsunclassified

Resultado del examen de certificación de médico pediatra de la Sociedad Argentina de Pediatría, años 2001-2010

Ferrero¹

2011

Arch Argent Pediat

View full text Add to dashboard Cite

RESUMENIntroducción. La certificación de los profesionales garantiza su adecuado desempeño, pero el examen correspondiente debe ser periódica-mente evaluado. Objetivo. Describir el resultado del examen de certificación de médico pediatra (ECMP) de la Sociedad Argentina de Pediatría (SAP), analizando el impacto de edad y el tiempo desde la graduación de los inscriptos. Métodos. Se analizaron los examinados por el ECMP, valorando tasa de aprobación e institución formadora (2001)(2002)(2003)(2004)(2005)(2006)(2007)(2008)(2009)(2010), y edad y años transcurridos desde la graduación (2001)(2002)(2003)(2004)(2005). Resultados. De 2527 profesionales pertenecientes a 138 instituciones, aprobó el 69,6%. Los aprobados presentaron edades (31,7 ± 4,1 contra 35,6 ± 6,2; p <0,0001) y años desde la graduación (6,3 ± 4,0 contra 9,0 ± 5,9; p <0,0001) menores que los desaprobados. La proporción de aprobados fue mayor en instituciones acreditadas por SAP por 5 años (78,4% contra 48,8%; OR= 3,8 IC95%= 3,1-4,7; p <0,001). Conclusión. Aprobaron el ECMP 69,6%. Los más jóvenes, con menos años de graduación y pertenecientes a programas acreditados por SAP, tuvieron mayor probabilidad de aprobar. Palabras clave: certificación, consejos de especialidades, acreditación de programas, residencia médica, evaluación educacional. SUMMARY Introduction.Professional certification guarantees professional's performance, but the examination tool must be periodically evaluated. Objective. To describe the result of the pediatric certifying examination (PCE) of the Sociedad Argentina de Pediatría (SAP), between 2001-2010 analyzing the impact of the age and the elapsed time since the graduation and to describe the performance of training institutions in this period. Methods. Cross-section study. Data were obtaind from the records of Board of Pediatrics of the SAP. The results of the PCE, were analyzed assessing examination pass rate and training institutions (2001)(2002)(2003)(2004)(2005)(2006)(2007)(2008)(2009)(2010), and age and elapsed time since graduation of the examined professionals (2001)(2002)(2003)(2004)(2005). Results. Of 2527 professionals from 138 institutions, 69.6% passed. Those that passed were younger (31.7 ± 4.1 vs. 35.6 ± 6.2 years; p <0.0001) and had less years since graduation (6.3 ± 4.0 vs. 9.0 ± 5.9; p <0.0001) than those who did not pass. The examination pass rate was higher in institutions accredited by SAP (78.4% vs. 48.8%;OR= 3,8 IC95%= 3,[1][2][3][4]7; p <0.001). The pass rate was significantly higher in institutions with accredited programs for 5 years than those not accredited (78.4% vs. 48.8%, OR= 3.8 95% CI= 3.1 to 4.7, p <0.001). The pass rate at accredited institutions for 3 years (53.7%) and 1 year (48.7%) showed no statistically significant differences with non-accredited institutions. Conclusion. The certifying examination pass rate was 68.5%. Younger professionals with fewer years since graduation, and trained in SAP 5 years accredited programs were significantly more likely to pass the examination.

show abstract

“…Certification by the ABMS and participation in continuing certification has been shown to translate into improved patient outcomes in non-EM specialties. [9][10][11][12][13][14][15][16] The criterion standard for MK assessment in EM has traditionally been certification by ABEM, which consists of a qualifying examination delivered in MCQ format and an oral examination. However, we were unable to locate any data on the effect ABEM certification has on patient-centered outcomes (e.g., Kirkpatrick level 4 evaluations).…”

Section: Multiple-choice Questions (Mcq) Testingmentioning

confidence: 99%

Assessing Medical Knowledge of Emergency Medicine Residents

Goyal

Aldeen

Leone

et al. 2012

Academic Emergency Medicine

View full text Add to dashboard Cite

The Accreditation Council for Graduate Medical Education (ACGME) requires that emergency medicine (EM) residency graduates are competent in the medical knowledge (MK) core competency. EM educators use a number of tools to measure a resident's progress toward this goal; it is not always clear whether these tools provide a valid assessment. A workshop was convened during the 2012 Academic Emergency Medicine consensus conference "Education Research in Emergency Medicine: Opportunities, Challenges, and Strategies for Success" where assessment for each core competency was discussed in detail. This article provides a description of the validity evidence behind current MK assessment tools used in EM and other specialties. Tools in widespread use are discussed, as well as emerging methods that may form valid assessments in the future. Finally, an agenda for future research is proposed to help address gaps in the current understanding of MK assessment.

show abstract

Predictive Validity of Certification by the American Board of Internal Medicine

Cited by 151 publications

References 10 publications

Predicting pass rates on the american board of internal medicine certifying examination

Predicting pass rates on the american board of internal medicine certifying examination

Resultado del examen de certificación de médico pediatra de la Sociedad Argentina de Pediatría, años 2001-2010

Assessing Medical Knowledge of Emergency Medicine Residents

Contact Info

Product

Resources

About