Reliability and Validity of a Test Designed to Assess Combat Medics' Readiness to Perform Life-Saving Procedures

Abstract

The test differentiates novices from beginners, competent, and proficient trainees on difficult procedures and overall performance.

Validation of an evaluation instrument for responders in tactical casualty care simulations

“…No studies of these characteristics have been our study in that the simulations were performed during the threat-free phase (warm or cold zone according to the Hartford Consensus), which was not considered in the above studies (19)(20) . The novelty of this study is the validation of the 3 tasks, which are fundamental in controlling bleeding both in the civilian and military environments.…”

Assessment of prehospital hemorrhage and airway care using a simulation model

“…The evaluation tool was adapted from an instrument (the Medical Simulation Combat Casualty Training Consortium Assessment Instrument) previously developed and validated at the University of Minnesota to assess performance in polytrauma scenarios. 7 The tool included eight items with global rating scales used to generate the participant’s global rater score (Table 2). The total point scale ranged from 5 to 40.…”

“…The evaluation tool utilized had previously been rigorously tested to determine its inter-rater reliability. 7…”

Training and Assessing Critical Airway, Breathing, and Hemorrhage Control Procedures for Trauma Care: Live Tissue Versus Synthetic Models

“…[28][29][30] We conducted a subsequent IRR analysis at the beginning of data collection at these sites to ensure adequate ICCs for PSs and percent agreement for CF and skips at the time of the study with our rater cohort using 24 subjects. Following this establishment of good-excellent IRR for all procedures on both models, aside from chest seal on LT and junctional hemorrhage on STM, which still displayed fair ICC (Table 3), each assessment scenario was rated by only one rater.…”

“…28 Subsequently, generalizability has been demonstrated with alterations in content (mainly construct irrelevance) for civilian first responders Twelve subjects performed all procedures on LT and 12 subjects performed all procedures on STM to calculate ICCs; three to four raters were rating each subject. % agree = % agreement between raters; CF = critical fail; Cric = cricothyrotomy; ICC = intraclass correlation coefficient; IRR = inter-rater reliability; LT = live tissue, NCD = needle thoracostomy; NPA = nasopharyngeal airway; PS = procedural score; skip = skipped procedure (or examination stopped due to failing three prior procedures); STM = synthetic training model; TQ = tourniquet.…”