The Development of a Validated Checklist for Radial Arterial Line Placement

Berg, Katherine; Riesenberg, Lee Ann; Berg, Dale; Schaeffer, Arielle; Davis, Joshua; Justice, Ellen; Tinkoff, Glen; Jasper, Edward

doi:10.1177/1062860613492189

Cited by 24 publications

(14 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To achieve consensus of expert opinion, the modified Delphi method, as outlined by Frallicciardi et al , Cumyn and Harris, Arthur et al and Berg et al ,13 19–21 was selected to establish the content validity of the assessment tool.…”

Section: Methodsmentioning

confidence: 99%

“…Search terms included ‘Healthcare simulation template,’ ‘Simulation template,’ ‘Simulation scenario design,’ and ‘Standardized simulation template.’ Six templates used for simulation scenario design were identified in the literature 3 5–9. The methods implemented by Cumyn and Harris, Arthur et al and Berg et al were used as a guide to content validation and the application of the modified Delphi method 19–21. This was a three-step process that included (1) initial delineation of assessment components and anchors, (2) creation of survey and implementation of the pilot and (3) obtaining consensus on the assessment tool using modified Delphi methodology 13 19–21Figure 1.…”

Section: Methodsmentioning

confidence: 99%

“…The methods implemented by Cumyn and Harris, Arthur et al and Berg et al were used as a guide to content validation and the application of the modified Delphi method 19–21. This was a three-step process that included (1) initial delineation of assessment components and anchors, (2) creation of survey and implementation of the pilot and (3) obtaining consensus on the assessment tool using modified Delphi methodology 13 19–21Figure 1. summarises the study methodology.…”

Section: Methodsmentioning

confidence: 99%

See 2 more Smart Citations

Development of a Simulation Scenario Evaluation Tool (SSET): modified Delphi study

Hernandez

Frallicciardi

Nadir

et al. 2019

BMJ Simul Technol Enhanc Learn

View full text Add to dashboard Cite

IntroductionOne critical aspect of successful simulation facilitation is development of written scenarios. However, there are no validated assessment tools dedicated to the evaluation of written simulation scenarios available. Our aim was to develop a tool to evaluate the quality of written simulation demonstrating content validity.MethodsA comprehensive literature search did not yield a validated assessment tool dedicated for the evaluation of written simulation scenarios. A subsequent search yielded six templates published for written simulation scenario design. From these templates, critical scenario elements were identified to create an evaluation instrument with six components of scenario quality with corresponding anchors and rating scale. Subsequently, a national group of simulation experts were engaged via survey methodology to rate the content of the proposed instrument. Ultimately, a modified two-round Delphi approach was implemented to demonstrate consensus of the final assessment tool.Results38 responses were obtained in round 1, while 22 complete responses were obtained in round 2. Round 1 kappa values ranged from 0.44 to 1.0, indicating moderate to almost perfect rater agreement for inclusion of the six proposed components. Kappa values specifically regarding scale and anchors ranged from 0 to 0.49. After revisions, there was a significant level of agreement (p<0.05) of all items of the proposed assessment tool in the second-round survey except for item 10. Of note, all initial respondents indicated that they had never evaluated written scenarios with an assessment tool.ConclusionsThe Simulation Scenario Evaluation Tool, developed using a national consensus of content experts, is an instrument demonstrating content validity that assesses the quality of written simulation scenarios. This tool provides a basis to guide structured feedback regarding the quality of written simulation scenarios.

show abstract

Section: Methodsmentioning

confidence: 99%

Section: Methodsmentioning

confidence: 99%

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Development of a Simulation Scenario Evaluation Tool (SSET): modified Delphi study

Hernandez

Frallicciardi

Nadir

et al. 2019

BMJ Simul Technol Enhanc Learn

View full text Add to dashboard Cite

show abstract

“…A 2014 study similarly utilized the modified Delphi method to develop a performance checklist for radial arterial line placement without ultrasound guidance. 15…”

Section: Introductionmentioning

confidence: 99%

Derivation of a procedural performance checklist for ultrasound-guided femoral arterial line placement using the modified Delphi method

et al. 2020

View full text Add to dashboard Cite

Background: Many specialties utilize procedural performance checklists as an aid to teach residents and other learners. Procedural checklists ensure that the critical steps of the desired procedure are performed in a specified manner every time. Valid measures of competency are needed to evaluate learners and ensure a standard quality of care. The objective of this study was to employ the modified Delphi method to derive a procedural checklist for use during placement of ultrasound-guided femoral arterial access. Methods: A 27-item procedural checklist was provided to 14 experts from three acute care specialties. Using the modified Delphi method, the checklist was serially modified based on expert feedback. Results: Three rounds of the study were performed resulting in a final 23-item checklist. Each item on the checklist received at least 70% expert agreement on its inclusion in the final checklist. Conclusion: A procedural performance checklist was created for ultrasound-guided femoral arterial access using the modified Delphi method. This is an objective tool to assist procedural training and competency assessment in a variety of clinical and educational settings.

show abstract

“…The development of a practice and assessment guideline for IO and LMA insertion in the emergency and pre-hospital contexts is essential to ensure reliable and accurate judgements of student and clinician performance. The Delphi technique has been used to develop such guidelines for other medical skills (Huang et al, 2009;Riesenberg, Berg, Berg, Schaeffer, Mealey, Davis, Weber, King, Justice, Geffe and Tinkoff, 2013;Berg et al, 2014;Hartman et al, 2014) and while some variation in specific applications of the Delphi method exists, several features are common including participant anonymnity, multiple iterative stages interspersed with controlled group feedback and aggregating group responses (Hasson et al, 2000). Expert judgements are pooled from participating individuals in order to establish concensus and agreement where existing information and guidance are limited (Keeney et al, 2011).…”

Section: Introductionmentioning

confidence: 99%

The development and critique of validated assessment tools for pre-hospital resuscitation skills

Seymour-Walsh¹

2019

IJES

View full text Add to dashboard Cite

Purpose The purpose of this paper is to describe the development of clinically credible skill practice and assessment guides for intraosseous (IO) needle insertion and laryngeal mask airway (LMA) insertion as two essential components of advanced life support (ALS) training. Design/methodology/approach A modified Delphi approach was used to determine expert consensus in the application of IO and LMA devices for the pre-hospital and emergency setting. Nine pre-hospital clinical specialists were recruited to participate in this Delphi study to determine consensus of clinical expert practice. Findings Two rounds were required to obtain a performance and assessment checklist for each skill. Both lists were then further modified to maximise their useability. However, the development of a “validated” checklist using a pre-determined process such as a Delphi approach is challenged. Rather, the implementation of these tools in a stated context, and analysis of the data they generate, is an essential aspect of validation which the Delphi approach does not address. Research limitations/implications Participant feedback regarding the rationale for their scores was limited in this study in order to minimise participant input and maximise completion of all rounds of the study. Further, devices used in the study may no longer be first-line choices with the advent of more modern devices including semi-automatic IO devices and LMAs which do not have inflatable cuffs. The refined checklists are able to be adapted to these newer devices. Practical implications Pre-hospital education contexts which may not have access to expert assessors who are skilled in providing global judgements now have access to clinically relevant skill-specific assessment tools for IO and LMA insertion. Originality/value Worldwide, ALS accreditation and competence is demanded of countless health professionals, and to date, validated practice and assessment guides specifically developed for the emergency setting for which they are used, are not available in the published literature. This paper proposes to fill that gap, in addition to guiding clinical education researchers in strategies to develop valid assessment tools through rigorous critique.

show abstract

The Development of a Validated Checklist for Radial Arterial Line Placement

Cited by 24 publications

References 13 publications

Development of a Simulation Scenario Evaluation Tool (SSET): modified Delphi study

Development of a Simulation Scenario Evaluation Tool (SSET): modified Delphi study

Derivation of a procedural performance checklist for ultrasound-guided femoral arterial line placement using the modified Delphi method

The development and critique of validated assessment tools for pre-hospital resuscitation skills

Contact Info

Product

Resources

About