A Pilot Study of the Creation and Implementation of a Teaching Development Assessment Tool

O’Toole, Jennifer K.; Klein, Melissa; McLinden, Daniel; Sucharew, Heidi; DeWitt, Thomas G.

doi:10.4300/jgme-d-14-00439.1

Cited by 2 publications

(5 citation statements)

References 17 publications

(18 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…7,8 These studies pointed out the educational significance of these tools, despite a few individual items having lower inter-rater reliability. 7,8 Although our tool demonstrated moderate to substantial agreement, we must evaluate how to improve reliability for our instrument. Ricotta et al 8 attributed their strong inter-rater reliability to iterative construct development and multifaceted faculty development.…”

Section: Discussionmentioning

confidence: 99%

“…Notably, previous studies have shown high kappa values for overall assessment tool but lower kappa values for individual steps. 7,8 These studies pointed out the educational significance of these tools, despite a few individual items having lower inter-rater reliability. 7,8…”

Section: Discussionmentioning

confidence: 99%

“…7,8 These studies pointed out the educational significance of these tools, despite a few individual items having lower inter-rater reliability. 7,8…”

Section: Discussionmentioning

confidence: 99%

“…Furthermore, designing an easy-to-use binary checklist allowed us to use nonphysician observers, which has previously been performed in the literature. 7,8 The use of nonphysician observers increases the feasibility of applying this tool at other institutions, with the data used as direct feedback to learners and as overall feedback to program leadership.…”

Section: Discussionmentioning

confidence: 99%

See 3 more Smart Citations

Designing a Checklist for Directly Observing Use of One-Minute Preceptor Steps on Inpatient Rounds: A Pilot Study

Puri

Lee

Feinglass

et al. 2023

J Contin Educ Health Prof

View full text Add to dashboard Cite

Background: "One-minute preceptor" (OMP) is a well-established educational technique; however, primary literature on OMP lacks a tool to assess behavioral change after delivery of curricula.Primary aim of this pilot study was to design a checklist for direct observation of teachers using OMP on general medicine rounds and obtain inter-rater reliability evidence for the checklist.Methods: This study pilots an internally designed 6-item checklist to assess change in directly observed behavior. We describe the process of developing the checklist and training the observers. We calculated a percent agreement and Cohen's kappa to assess inter-rater reliability. Results: Raters had a high percent agreement ranging from 0.8 to 0.9 for each step of OMP. Cohen's kappa ranged from 0.49 to 0.77 for the five OMP steps. The highest kappa obtained was for getting a commitment (k = 0.77) step, whereas the lowest agreement was for correcting mistakes (k = 0.49). Conclusion:We showed a percent agreement $0.8 and moderate agreement based on Cohen's kappa with most steps of OMP on our checklist. A reliable OMP checklist is an important step in further improving the assessment and feedback of resident teaching skills on general medicine wards.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

“…7,8 These studies pointed out the educational significance of these tools, despite a few individual items having lower inter-rater reliability. 7,8…”

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

See 2 more Smart Citations

Designing a Checklist for Directly Observing Use of One-Minute Preceptor Steps on Inpatient Rounds: A Pilot Study

Puri

Lee

Feinglass

et al. 2023

J Contin Educ Health Prof

View full text Add to dashboard Cite

show abstract

“…• Training of instructors in both delivery of clinical teaching and pedagogy-based approaches. Trained clinical instructors are better at delivering clinical teaching and are usually more satisfied [4,15,[40][41][42]. Currently, veterinary instructors rarely, if ever, receive official training in clinical teaching, and there are no standardized requirements.…”

Section: Clinical Teaching Skills Of Instructorsmentioning

confidence: 99%

Effective Veterinary Clinical Teaching in a Variety of Teaching Settings

Carr

Kirkwood

Petrovski

2022

Veterinary Sciences

View full text Add to dashboard Cite

This review explores different modalities for clinical teaching of veterinary learners globally. Effective clinical teaching aims to prepare graduates for a successful career in clinical practice. Unfortunately, there is scant literature concerning clinical teaching in veterinary medicine. Our intent for this review is to stimulate and/or facilitate discussion and/or research in this important area. We discuss the different forms that veterinary clinical teaching can take, depending on their setting, which can be university-based clinical activities, work-based in commercial clinical practices, or in a traditional academic setting with little to no real-time exposure to clients and patients. We suggest that each of these modalities has a place in clinical teaching of veterinary learners at any point in the curriculum but that a mix of these approaches will likely provide an improved experience for the learner. Further, we discuss strategies to improve clinical teaching in these different settings. Potential strategies related to the teaching skills of clinical instructors could include training in delivery of clinical teaching in a variety of learning settings, and instructors’ official recognition, including opportunities for career progression. Potential strategies to improve clinical teaching in different teaching settings would vary with the learning settings. For example, in traditional academic settings, case-based learning with incorporation of simulation models is one proposed strategy. The involvement of learners in ‘teach-others’ is a strategy for both traditional academic and clinical settings. Finally, clearly addressing Day One competencies is required in any clinical teaching setting.

show abstract

A Pilot Study of the Creation and Implementation of a Teaching Development Assessment Tool

Abstract: Background The importance of effective clinical teaching skills is well established in the literature. However, reliable tools with validity evidence that are able to measure the development of these skills and can effectively be used by nonphysician raters do not exist.

Cited by 2 publications

References 17 publications

Designing a Checklist for Directly Observing Use of One-Minute Preceptor Steps on Inpatient Rounds: A Pilot Study

Designing a Checklist for Directly Observing Use of One-Minute Preceptor Steps on Inpatient Rounds: A Pilot Study

Effective Veterinary Clinical Teaching in a Variety of Teaching Settings

Contact Info

Product

Resources

About