Validation of the Objective Structured Assessment of Technical Skill in Brasil

Campos, Marcelo Esteves Chaves; Oliveira, Marcelo Magaldi; Assis, Lílian Bambirra de; Reis, Augusto Barbosa; Gonçalves, Flávio B.

doi:10.1590/1806-9282.66.3.328

Cited by 4 publications

(5 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Thus, this assessment tool must be accompanied by another form of performance quantification. In this study, we opted for the OSATS, which is the global assessment scale, most used for this purpose, and which was recently validated for the Portuguese language 14 . For Ghanem et al, the use of the global rating scales in these assessments has the main objective of increasing the objectivity and quantification of performance, reducing the subjective effect of this assessment.…”

Section: Discussionmentioning

confidence: 99%

“…All 13 sentences allowed the following response possibilities: completely disagree (1 point), partially disagree (2 points), neither agree nor disagree (3 points), partially agree (4 points), completely agree (5 points). Both assessment tools (OSATS and SSSCL) were used in their duly validated versions for the Portuguese language 14,15 . Source: Costa et al 17 .…”

Section: Assessment Of the Gain Of Skills And Competencesmentioning

confidence: 99%

See 1 more Smart Citation

Low-fidelity simulation models in urology resident’s microsurgery training

Pinto,

Silva,

Bentes

et al. 2023

Acta Cir. Bras.

View full text Add to dashboard Cite

To evaluate the gain of microsurgical skills and competencies by urology residents, using low-fidelity experimental models. Methods: The study involved the use of training boards, together with a low-fidelity microsurgery simulator, developed using a 3D printer. The model consists in two silicone tubes, coated with a resin, measuring 10 cm in length and with internal and external diameters of 0.5 and 1.5 mm. The support for the ducts is composed by a small box, developed with polylactic acid. The evaluation of the gain of skills and competencies in microsurgery occurred throughout a training course consisting of five training sessions. The first sessions (S1-S4) took place at weekly intervals and the last session (S5) was performed three months after S4.During sessions, were analyzed: the speed of performing microsurgical sutures in the pre and post-training and the performance of each resident through the Objective Structure Assessment of Technical Skill (OSATS) and Student Satisfaction Self-Confidence tools in Learning (SSSCL). Results: There was a decrease in the time needed to perform the anastomosis (p=0.0019), as well as a progressive increase in the score in the OSATS over during sessions S1 to S4. At S5, there was a slightly decrease in performance (p<0.0001), however, remaining within the expected plateau for the gain of skills and competences. The SSSCL satisfaction scale showed an overall approval rating of 96.9%, with a Cronback alpha coefficient of 83%. Conclusion: The low-fidelity simulation was able to guarantee urology residents a solid gain in skills and competencies in microsurgery.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Assessment Of the Gain Of Skills And Competencesmentioning

confidence: 99%

Low-fidelity simulation models in urology resident’s microsurgery training

Pinto,

Silva,

Bentes

et al. 2023

Acta Cir. Bras.

View full text Add to dashboard Cite

show abstract

“…As important as teaching to the learner is feedback 19 . Therefore, we used two tools that have been validated in the literature: the Specific Checklist for Suture and the GOALS 13 , 14 .…”

Section: Discussionmentioning

confidence: 99%

“…In this study residents of different specialties participated, and training was divided in Basic and Endosuture modules, in which the developed laparoscopic skills were needed in different surgical contexts. The selection preferably of residents of the last year is justified, as these will be those who will As important as teaching to the learner is feedback 19 . Therefore, we used two tools that have been validated in the literature: the Specific Checklist for Suture and the GOALS 13,14 .…”

Section: Residency Training For Minimally Invasive Surgerymentioning

confidence: 99%

Residency training for minimally invasive surgery

Campos

Monteiro

Kakehasi

2022

Rev. Col. Bras. Cir.

Self Cite

View full text Add to dashboard Cite

Objective: to develop a training program in minimally invasive surgery, based on simulation and with an emphasis on the acquisition of laparoscopic competences. Methods: this was a prospective, observational study carried out at a university hospital in Belo Horizonte, Brazil, between April 2020 and January 2021. We recruited residents of surgical specialties for structured, progressive training according to instructional principles to promote learning, such as motivation, activation, demonstration, application, and integration. We filmed the skill tests at the program’s beginning, middle, and end, which were then anonymously evaluated by a surgical education expert. Individual performances were scored using the global assessment tools “GOALS” and “specific checklist for suture”. At the end, all participants received individual feedback and completed a questionnaire to assess the impact of training on the Kirkpatrick model. Results: 43 residents completed the program. The evolution of performances was evident and grew between tests. The average achievements were 29% in the initial test, 43% in the intermediate test, and 88% in the final test, with significant differences between all mean scores, with H=97.59, GL=2, p<0.0001. The program evaluation and learning perceptions were excellent, but only 10.7% of residents felt fully capable of performing unsupervised, low-complexity laparoscopic surgery at the end of training. Conclusions: the training program developed in this study proved to be feasible and promising as a strategy for teaching laparoscopic surgery.

show abstract

“…Several models have been proposed in teaching and learning of microsurgery practice (10,11). While assessment of learning skills and abilities gained by the trainees is imperative (12)(13)(14), to our knowledge there are no published studies reporting simulation in evaluation of surgical skills in microsurgical varicocelectomy. The purpose of this study was to fill this gap by developing and validating such a test of specific technical skill for microsurgical varicocelectomy simulation model.…”

Section: Introductionmentioning

confidence: 99%

Development and validation a task-specific checklist for a microsurgical varicocelectomy simulation model

et al. 2020

Self Cite

View full text Add to dashboard Cite

Purpose: To develop and validate a new test of specific technical skills required for microsurgical varicocelectomy. Materials and Methods: An electronic questionnaire was sent to 558 members of the Brazilian Society of Urology for the validation of the task-specific checklist (TSC) for assessment of microsurgical varicocelectomy. Participants who had experience in this procedure were selected as judges. For construct validation, 12 participants including attending urologists and urological residents in training were recruited for voluntary participation. We formed a group of three experts and a group of nine novices, who had to perform the steps of microsurgical varicocelectomy on a simulation model using human placenta. Each participant was filmed and two blinded raters would then evaluate their performance using the TSC of microsurgical varicocelectomy. Results: 14 judges were recruited. The assessment tool was reformulated, according to the judges suggestions and had the content validity achieved. The final version of the TSC was comprised of the task-specific score, a series of 4 items scored in a binary fashion designed for microscopic sub-inguinal varicocelectomy. The differences between the performance of participants with different levels of experience reflected the construct validity. The reliability between the raters was high. The mean time required to complete the training of microsurgical varicocelectomy in simulation model was significantly shorter for experts compared to novices (201 vs. 496 seconds, p=0.01). Conclusions: This preliminary study suggests that the task-specific checklist of microsurgical varicocelectomy is reliable and valid in assessing microsurgical skills.

show abstract

Validation of the Objective Structured Assessment of Technical Skill in Brasil

Cited by 4 publications

References 21 publications

Low-fidelity simulation models in urology resident’s microsurgery training

Low-fidelity simulation models in urology resident’s microsurgery training

Residency training for minimally invasive surgery

Development and validation a task-specific checklist for a microsurgical varicocelectomy simulation model

Contact Info

Product

Resources

About