The validity and reliability of a Direct Observation of Procedural Skills assessment tool: assessing colonoscopic skills of senior endoscopists

Assessing Competences in Medical Students with a Newly Designed 360- Degree Examination of a Simulated First Day of Residency: A Feasibility Study

“…This assessment organized like a triple jump [27] with history taking, patient management phase, and handover, is very closely related to the daily routine of a first year resident. Even though it lacks the assessment of clinical skills like physical examination, which can be examined by mini-CEX [7] and DOPS [8], it provides the possibility to assess competences like handling difficult patient encounters, clinical reasoning, and patient management. Furthermore, medial attitudes and entrustable professional activities can be rated with this assessment.…”

Assessments and skills improvement for endoscopists

“…In the UK, a number of procedure specific competency assessment tools have been developed and validated, so-called DOPS (direct observation of skill or procedure). DOPS provide a competency framework for trainees to follow using a well-structured format to objectively assess individuals on their performance [5,6].…”

“…The DOPS is an assessment tool designed to evaluate the performance of a trainee undertaking a practical procedure, against a structured checklist [6,7]. The trainee receives immediate feedback to identify strengths and areas for development [8].…”

“…Until the criteria in the table are met, the JETS system will not allow a trainee to progress and request a summative assessment. Summative assessments are made using two assessors on two cases, which has been determined to have construct validity using generalizability theory [6,10].…”

Assessing fellow skills: practice what you preach, measure what you teach

“…These include the Direct Observation of Procedural Skills (DOPS) tool developed in the United Kingdom, the Global Assessment of Gastrointestinal Endoscopy Skills (GAGES) created by surgical endoscopists, and finally the Mayo Colonoscopy Skills Assessment Tool (MCSAT), along with its derivative, the Assessment of Competency in Endoscopy (ACE) tool reported by the American Society for Gastrointestinal Endoscopy training committee. [1][2][3][4] The DOPS and GAGES tools focus on a select number of motor skills but do not assess critical cognitive interpretation and decision-making skills. Although the DOPS tool has been in wide use across the United Kingdom for many years as part of a very sophisticated centralized electronic reporting system in high-stakes assessment, only recently have learning curves from these data been reported to make competency benchmarking possible by using this scoring system.…”