Levels of Continuing Veterinary Medical Education Program Evaluation: Assessing a Course on Dairy Reproductive Management

Abstract

There are four different levels of continuing education program evaluation: participant perceptions of the program or course; participant competence with new skills, knowledge, and abilities; participant performance or change in behavior; and health care or client outcomes, such as resultant changes in patient care or herd/flock production performance. The purpose of this article is to describe different levels of evaluation and demonstrate some methods used in evaluating a continuing veterinary medical education (CVME) course in dairy reproductive management. Participants' learning needs were assessed using learning stage theory and a pre-test of knowledge. Post-program assessments included a test of knowledge, a satisfaction survey, a commitment to change, and self-reported behavior change. The results of the evaluation indicate that self-reports of learning needs do not necessarily reflect actual needs and that satisfaction with a course does not necessarily indicate behavior change. Providers of CVME must recognize the value of program evaluation, as well as the advantages and disadvantages of different evaluation methods.

Dairy calving management: Description and assessment of a training program for dairy personnel

“…Four levels of summative evaluation have been reported (Andreasen et al, 2001;Moore et al, 2004;Schuenemann et al, 2011a). The present study assessed participant perceptions about the program (level 1), competence with new knowledge or skills (level 2), and adopting the calving practices learned (behavioral change; level 3).…”

Dairy nutrition management: Assessing a comprehensive continuing education program for veterinary practitioners

“…Assessing learning needs is an important component in any CVME program, not only for program accreditation, but also for post-delivery assessments and curriculum development (Moore et al, 2004). A comprehensive CVME program must be able to (1) provide new knowledge for immediate field application, (2) encourage discussion, (3) collect feedback, and (4) follow-up after program delivery (with participants and instructors).…”

“…Continuing veterinary medical education (CVME) programs provide a unique opportunity for practicing veterinarians to learn about the most recent discoveries in their field and to update their knowledge (Moore et al, 2004;Di Croce et al, 2008;Schuenemann et al, 2010). Comprehensive CVME programs that offer the latest research-based information, encourage discussion between participants and instructors, and promote open communication channels between individuals in the field and the land-grant universities have great likelihood of addressing the ultimate needs of the dairy industry.…”

Assessing and enhancing quality through outcomes‐based continuing professional development (CPD): a review of current practice

“…Finally, summative assessment can be employed at the end of a CPD activity to attempt to determine if it has achieved its objectives. Summative assessment techniques used in CPD programmes to date include self‐report questionnaires, knowledge tests and commitment‐to‐change approaches (with follow‐up) (Moore and others 2004, Wakefield 2004).…”

“…Analytical evidence may include self‐audit and the preparation of self‐reflective statements. However, self‐analytical approaches have received criticism for lacking transparency and placing too much trust in the individual (Bradshaw 1998, Moore and others 2004). Reputational evidence will often involve feedback, and reflection on feedback, from colleagues.…”