The evolution of self and hetero-evaluation of repeated high fidelity simulation scenarios of post-partum hemorrhage with anesthesia trainees

Abstract

IntroductionEvidence for self-assessment in medicine is controversial with participants under-rating or overestimating their performance. It is also unclear whether this under or overestimation changes during the process of repeated simulation experience. In this study, the authors analyzed the evolution of the behavioral skills of anesthesia trainees during four consecutive standardized postpartum hemorrhages (PPH) high-fidelity simulation scenarios. They compared the self-assessment made by the leader himself and the assessment made by his teammates individually with the assessment made by two expert observers. MethodsThe authors enrolled forty anesthesia trainee volunteers and divided them into eight teams of five participants each. Each team enacted the same scenario of a patient with atonic PPH following vaginal delivery four times so that all the trainees, except the one assigned the leader's role, could rotate through the roles of anesthesia trainee, obstetrician, midwife, and nurse. The participants themselves and two expert observers, using standardized checklists and questionnaires, carried out an evaluation of the technical (diagnosis and treatment of atonic PPH) and behavioral (leadership, communication, situational awareness, and overall appraisal) skills evidenced in the scenarios. ResultsThe authors noted a progressive improvement in the behavioral scores given to the leader by the examiners, his team, and himself, from the first to the fourth scenario. The scores given by the participants and by the leader himself were greater than those given by the independent observers in the first two scenarios but these differences were no longer significant during the last two scenarios.