Comparison of resident self-assessments with trained faculty and standardized patient assessments of clinical and technical skills in a structured educational module

Brewster, Luke P.; Risucci, Donald A.; Joehl, Raymond J.; Littooy, Fred N.; Temeck, Barbara K.; Blair, Patrice Gabler; Sachdeva, Ajit K.

doi:10.1016/j.amjsurg.2007.08.048

Cited by 44 publications

(42 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Consequently, a total of 12 papers were included (Table 3). 7,8,11,12,[16][17][18][19][20][21][22][23] According to our criteria, eight studies (66.7%) found that self-assessment of technical skills is accurate (Table 4). 11,[16][17][18][19][20][21][22] All studies were evidence level 2b.…”

Section: Resultsmentioning

confidence: 99%

“…18 One study indicated that unfamiliarity with selfassessment rating tools was a potential reason for poor selfassessment accuracy. 12 Self-assessors used retrospective video playback analysis in three studies (25.0%) 16,19,23 and its use was ambiguous in a further study (8.3%). 21 Self-assessment was accurate in three (75.0%) of these four studies.…”

Section: Assessment Toolsmentioning

confidence: 99%

“…21 Self-assessment was accurate in three (75.0%) of these four studies. 16,19,21 Only Ward et al compared direct versus video self-assessment. 16 They found that the accuracy of self-assessment improved significantly Retrospective video playback analysis was used by the observers in six studies (50.0%).…”

Section: Assessment Toolsmentioning

confidence: 99%

“…Two studies used two tools. 16,23 The following assessment tools were used in studies reporting that self-assessment is accurate: the operative component rating scale, 16 objective surgical skills assessment, 22 hierarchical task analysis, 18 standardised forms 19 and a self-assessment score of performance 20 (level 3 recommendation). Poor accuracy of selfassessment or divergent results were seen using the global rating scale, 7,12,16,17 objective structured assessment of technical skills, 11,21,23 a visual analogue scale 8 and a global score.…”

Section: Assessment Toolsmentioning

confidence: 99%

“…The self-assessors were categorised according to surgical level in five studies (41.7%) 8,16,17,19,22 and experience level in four (33.3%). 7,11,12,21 The accuracy of self-assessment improved with experience in two studies (16.7%) 11,23 (level 2 recommendation) and with surgical level in one study (8.3%) 22 (level 3 recommendation).…”

Section: Participants Undertaking the Self-assessment Processmentioning

confidence: 99%

See 4 more Smart Citations

Are general surgeons able to accurately self-assess their level of technical skills?

Rizan

Ansell²,

Tilston

et al. 2015

annals

View full text Add to dashboard Cite

Introduction Self-assessment is a way of improving technical capabilities without the need for trainer feedback. It can identify areas for improvement and promote professional medical development. The aim of this review was to identify whether selfassessment is an accurate form of technical skills appraisal in general surgery. Methods The PubMed, MEDLINE®, Embase™ and Cochrane databases were searched for studies assessing the reliability of self-assessment of technical skills in general surgery. For each study, we recorded the skills assessed and the evaluation methods used. Common endpoints between studies were compared to provide recommendations based on the levels of evidence. Results Twelve studies met the inclusion criteria from 22,292 initial papers. There was no level 1 evidence published. All papers compared the correlation between self-appraisal versus an expert score but differed in the technical skills assessment and the evaluation tools used. The accuracy of self-assessment improved with increasing experience (level 2 recommendation), age (level 3 recommendation) and the use of video playback (level 3 recommendation). Accuracy was reduced by stressful learning environments (level 2 recommendation), lack of familiarity with assessment tools (level 3 recommendation) and in advanced surgical procedures (level 3 recommendation). Conclusions Evidence exists to support the reliability of self-assessment of technical skills in general surgery. Several variables have been shown to affect the accuracy of self-assessment of technical skills. Future work should focus on evaluating the reliability of self-assessment during live operating procedures.

show abstract