Exploring Validation and Verification

Barnes, J.J.; Konia, Mojca Remskar

doi:10.1097/sih.0000000000000298

Cited by 12 publications

(4 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Although certification in medical simulations is becoming more of a priority to identify best practices for a wide range of providers and applications [322], the credibility of medical simulation models remains largely underexplored. Barnes and Konia confirmed many different interpretations and accomplishments in healthcare simulation studies [323]. For example, Abir et al developed a discrete-event simulation model to predict capacity bottlenecks at a medical centre [176], allowing for improved decision-making with changes in the working environment.…”

Section: Medical Simulation Verification and Validationmentioning

confidence: 92%

A Literature Study of Medical Simulations for Non-Technical Skills Training in Emergency Medicine: Twenty Years of Progress, an Integrated Research Framework, and Future Research Avenues

Zhang

2023

IJERPH

View full text Add to dashboard Cite

Medical simulations have led to extensive developments in emergency medicine. Apart from the growing number of applications and research efforts in patient safety, few studies have focused on modalities, research methods, and professions via a synthesis of simulation studies with a focus on non-technical skills training. Intersections between medical simulation, non-technical skills training, and emergency medicine merit a synthesis of progress over the first two decades of the 21st century. Drawing on research from the Web of Science Core Collection’s Science Citation Index Expanded and Social Science Citation Index editions, results showed that medical simulations were found to be effective, practical, and highly motivating. More importantly, simulation-based education should be a teaching approach, and many simulations are utilised to substitute high-risk, rare, and complex circumstances in technical or situational simulations. (1) Publications were grouped by specific categories of non-technical skills, teamwork, communication, diagnosis, resuscitation, airway management, anaesthesia, simulation, and medical education. (2) Although mixed-method and quantitative approaches were prominent during the time period, further exploration of qualitative data would greatly contribute to the interpretation of experience. (3) High-fidelity dummy was the most suitable instrument, but the tendency of simulators without explicitly stating the vendor selection calls for a standardised training process. The literature study concludes with a ring model as the integrated framework of presently known best practices and a broad range of underexplored research areas to be investigated in detail.

show abstract

Section: Medical Simulation Verification and Validationmentioning

confidence: 92%

A Literature Study of Medical Simulations for Non-Technical Skills Training in Emergency Medicine: Twenty Years of Progress, an Integrated Research Framework, and Future Research Avenues

Zhang

2023

IJERPH

View full text Add to dashboard Cite

show abstract

“…Secondary outcomes were perceived clinical accuracy, relevancy to practice, and side effects experienced as further verification and validation evidence for our platform 23 . The survey tool was adapted from previous research, 24 consisting of five‐point anchored response questions, three‐point comparisons of efficacy, and yes/no questions.…”

Section: Methodsmentioning

confidence: 99%

Multiuser immersive virtual reality simulation for interprofessional sepsis recognition and management

Zackoff,

Cruse,

Sahay

et al. 2024

Journal of Hospital Medicine

View full text Add to dashboard Cite

IntroductionSepsis is a leading cause of pediatric mortality. While there has been significant effort toward improving adherence to evidence‐based care, gaps remain. Immersive multiuser virtual reality (MUVR) simulation may be an approach to enhance provider clinical competency and situation awareness for sepsis.MethodsA prospective, observational pilot of an interprofessional MUVR simulation assessing a decompensating patient from sepsis was conducted from January to June 2021. The study objective was to establish validity and acceptability evidence for the platform by assessing differences in sepsis recognition between experienced and novice participants. Interprofessional teams assessed and managed a patient together in the same VR experience with the primary outcome of time to recognition of sepsis utilizing the Situation Awareness Global Assessment Technique analyzed using a logistic regression model. Secondary outcomes were perceived clinical accuracy, relevancy to practice, and side effects experienced.ResultsSeventy‐two simulations included 144 participants. The cumulative odds ratio of recognizing sepsis at 2 min into the simulation in comparison to later time points by experienced versus novice providers were significantly higher with a cumulative odds ratio of 3.70 (95% confidence interval: 1.15–9.07, p = .004). Participants agreed that the simulation was clinically accurate (98.6%) and will impact their practice (81.1%), with a high degree of immersion (95.7%–99.3%), and the majority of side effects were perceived as mild (70.4%–81.4%).ConclusionsOur novel MUVR simulation demonstrated significant differences in sepsis recognition between experienced and novice participants. This validity evidence along with the data on the simulation's acceptability supports expanded use in training and assessment.

show abstract

“…The second area is validation in engineering contexts. System designers often discuss methods of verification, validation, and accreditation 23,24 . In this context, validity refers to whether a product or system meets the customer's needs.…”

Section: Historical Considerationsmentioning

confidence: 99%

Preparing and Presenting Validation Studies

Calhoun

Scerbo

2022

Sim Healthcare

View full text Add to dashboard Cite

Simulated environments are frequently used for learner assessment, and a wide array of assessment instruments have been created to assist with this process. It is important, therefore, that clear, compelling evidence for the validity of these assessments be established. Contemporary theory recognizes instrument validity as a unified construct that links a construct to be assessed with a population, an environment of assessment, and a decision to be made using the scores. In this article, we present a primer on 2 current frameworks (Messick and Kane), define the elements of each, present a rubric that can be used by potential authors to structure their work, and offer examples of published studies showing how each framework has been successfully used to make a validity argument. We offer this with the goal of improving the quality of validity-related publications, thereby advancing the quality of assessment in healthcare simulation.

show abstract

Exploring Validation and Verification

Cited by 12 publications

References 20 publications

A Literature Study of Medical Simulations for Non-Technical Skills Training in Emergency Medicine: Twenty Years of Progress, an Integrated Research Framework, and Future Research Avenues

A Literature Study of Medical Simulations for Non-Technical Skills Training in Emergency Medicine: Twenty Years of Progress, an Integrated Research Framework, and Future Research Avenues

Multiuser immersive virtual reality simulation for interprofessional sepsis recognition and management

Preparing and Presenting Validation Studies

Contact Info

Product

Resources

About