Evaluation of assessment in the context of work‐based learning: Qualitative perspectives of new graduates

Abstract

Aim Evaluation or assessment of competence is an important step to ensure the safety and efficacy of health professionals, including dietitians. Most competency-based assessment studies are focused on valid and reliable methods of assessment for the preparation of entry-level dietitians, few papers have explored student dietitians' perceptions of these evaluations. The present study aimed to explore the perceptions of recent graduates from accredited nutrition and dietetics training programs in Australia. It also aimed to establish the relevance of competency-based assessment to adequately prepare them for entry-level work roles. Methods A purposive sample of newly graduated dietitians with a range of assessment experiences and varied employment areas was recruited. A qualitative approach, using in-depth interviews with 13 graduates, was undertaken. Graduates were asked to reflect upon their competency-based assessment experiences as a student. Data were thematically analysed by multiple authors. Results Four themes emerged from the data analysis: (i) transparency and consistency are critical elements of work-based competency assessment; (ii) students are willing to take greater responsibility in the assessment process; (iii) work-based competency assessment prepares students for employment; and (iv) the relationship between students and their assessors impacts student experience and assessment performance. Conclusions Understanding this unique perspective of students can improve evaluation of future health professionals and assist in validating competency-based assessment approaches. Authorship:All authors contributed to the design of the study. CP conducted the interviews. CP and AC undertook the data analysis and drafted the manuscript. SA and EB performed subset of data analysis. All authors verified data analysis and contributed to development of manuscript. Conflict of Interest:The authors have no conflict of interest to declare.

Clinical educators’ skills and qualities in allied health: a systematic review

“…These sociocultural elements of practice shape development and are essential to the advancement of clinical and professional skills. Students have reported loss of confidence and bullying while on clinical placement, as well as ambiguous and inconsistent evaluation and assessment . The skills and qualities of CEs identified in this review may support the selection and training of CEs in the future.…”

Are dietetics educators' attitudes to assessment a barrier to expanding placement opportunities? Results of a Delphi study

“…The positions found in this study are not congruent with the modern understanding of assessment of competence that should be focused on a systems‐based approach to assessment that recognises the role of multiple pieces of assessment as contributing to judgement of competence . Involving the student in assessment may also be considered . Setting standards for assessment in the work‐based placement setting is an essential part of an assessment system for entry‐level competency.…”

“…The results of this study also report dissatisfaction with current performance criteria and may reflect different interpretations of, or reflect ambiguity in, the current entry‐level competencies for dietitians among academics and practitioners. Recent work has shown that students perceive clinical educators to have difficulty interpreting the actual requirements of competence . If this is the case, then opinions on how this assessment takes place may be flawed.…”

“…The lack of consensus on 80 of the 166 performance criteria, which cannot be interpreted is unknown. While there was little additional agreement between rounds one and two of the Delphi survey, a third was not undertaken as a workshop of interested parties conducted as part of a larger activity, suggested that further agreement would be difficult to reach . There is a need for health professional groups to set standards for achievement of competence as part of a system of assessment.…”

Growing professional competence in nutrition and dietetics

“…In Australia, a diverse range of approaches has been used to develop competency standards for dietitians . Despite their differences, all these approaches have incorporated the views of experts as to what constitutes ‘competence’ notwithstanding the fact that the profession has expressed difficulties in defining competence . Although patients' needs seem to have been a driver for the competency‐based education movement, patients themselves have had little say in the development of standards of performance.…”