The Acute Care Assessment Tool: a new assessment in acute medicine

Johnson, Gavin; Wade, Winnie; Barrett, James; Jones, Malcolm V.

doi:10.1111/j.1743-498x.2009.00270.x

Cited by 8 publications

(7 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, the scoring system of this scale was felt to be ambiguous, with concerns that junior trainee performances were often inappropriately rated as competent, or highly skilled. Research based on other formative assessment tools in the UK for doctors in training, including the Acute Care Assessment Tool (ACAT) [7], case-based discussions (CBD) [7], and mini-clinical evaluation exercise (mini-CEX) [8], had indicated that the change in scoring formats from a performance-based scale, to one based on the required degree of supervision, and hence readiness for independent unsupervised practice, led to improved reliability of these assessment tools [7,8]. In July 2016, the DOPS scoring format was changed to a supervision-based scale to align assessment outcomes with these generic assessment tools.…”

Section: Introductionmentioning

confidence: 99%

Changes in scoring of Direct Observation of Procedural Skills (DOPS) forms and the impact on competence assessment

et al. 2018

Self Cite

View full text Add to dashboard Cite

show abstract

Section: Introductionmentioning

confidence: 99%

Changes in scoring of Direct Observation of Procedural Skills (DOPS) forms and the impact on competence assessment

et al. 2018

Self Cite

View full text Add to dashboard Cite

show abstract

“…We recommend that the Pharmacy ACAT be considered for routine use by RPS foundation trainees across Great Britain, both in hospital and community practice. We agree that ‘the ACAT form could be modified for use in many different clinical settings, and in different health care systems’, and believe that the Pharmacy ACAT may potentially be useful for undergraduate pharmacy students undertaking work‐based placements.…”

Section: Discussionmentioning

confidence: 96%

“…With permission, the Joint Royal Colleges of Physicians ACAT tool was adapted to become the ‘Pharmacy ACAT’ (Appendix S1). This gave us the first pharmacy WPBA tool to review a period of working at ward level or in the pharmacy, but the key imperative was to develop a WPBA that ‘plugs the gap’ around ward supervision for foundation pharmacists, over and above observing individual patient encounters. Two versions were produced, one using the language and competency cluster statements from the Royal Pharmaceutical Society Foundation Pharmacy Framework, and the other using the RPS Advanced Pharmacy Framework .…”

Section: Methodsmentioning

confidence: 99%

“…T he Acute Care Assessment Tool (ACAT) was developed by an experienced group of UK doctors as a workplace-based assessment (WPBA). 1 It is used to assess the performance of a medical trainee following a period of working in acute medicine, and a pilot demonstrated its merit as a formative assessment. The purpose of this article is to describe the development of the 'Pharmacy ACAT' and a subsequent pilot in the hospital pharmacy setting.…”

Section: Introductionmentioning

confidence: 99%

“…The Acute Care Assessment Tool (ACAT) was developed by an experienced group of UK doctors as a workplace‐based assessment (WPBA) . It is used to assess the performance of a medical trainee following a period of working in acute medicine, and a pilot demonstrated its merit as a formative assessment.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

The Acute Care Assessment Tool: ‘Pharmacy ACAT’

et al. 2016

View full text Add to dashboard Cite

show abstract

Good questions, good answers: construct alignment improves the performance of workplace-based assessment scales

Crossley¹,

Johnson²,

Booth³

et al. 2011

Medical Education

Self Cite

194

187

View full text Add to dashboard Cite

CONTEXT Assessment in the workplace is important, but many evaluations have shown that assessor agreement and discrimination are poor. Training discussions suggest that assessors find conventional scales invalid. We evaluate scales constructed to reflect developing clinical sophistication and independence in parallel with conventional scales.METHODS A valid scale should reduce assessor disagreement and increase assessor discrimination. We compare conventional and construct-aligned scales used in parallel to assess approximately 2000 medical trainees by each of three methods of workplace-based assessment (WBA): the mini-clinical evaluation exercise (mini-CEX); the acute care assessment tool (ACAT), and the case-based discussion (CBD). We evaluate how scores reflect assessor disagreement (V j and V j*p ) and assessor discrimination (V p ), and we model reliability using generalisability theory.RESULTS In all three cases the conventional scale gave a performance similar to that in previous evaluations, but the construct-aligned scales substantially reduced assessor disagreement and substantially increased assessor discrimination. Reliability modelling shows that, using the new scales, the number of assessors required to achieve a generalisability coefficient ‡ 0.70 fell from six to three for the mini-CEX, from eight to three for the CBD, from 10 to nine for 'on-take' ACAT, and from 30 to 12 for 'post-take' ACAT. CONCLUSIONSThe results indicate that construct-aligned scales have greater utility, both because they are more reliable and because that reliability provides evidence of greater validity. There is also a wider implication: the disappointing reliability of existing WBA methods may reflect not assessors' differing assessments of performance, but, rather, different interpretations of poorly aligned scales. Scales aligned to the expertise of clinician-assessors and the developing independence of trainees may improve confidence in WBA.assessment

show abstract

The Acute Care Assessment Tool: a new assessment in acute medicine

Cited by 8 publications

References 5 publications

Changes in scoring of Direct Observation of Procedural Skills (DOPS) forms and the impact on competence assessment

Changes in scoring of Direct Observation of Procedural Skills (DOPS) forms and the impact on competence assessment

The Acute Care Assessment Tool: ‘Pharmacy ACAT’

Good questions, good answers: construct alignment improves the performance of workplace-based assessment scales

Contact Info

Product

Resources

About