A Student Assessment Tool for Standardized Patient Simulations (SAT-SPS): Psychometric analysis

Castro-Yuste, Cristina; García-Cabanillas, María José; Rodríguez-Cornejo, María Jesús; Fuentes, Concepción Carnicer; Paloma‐Castro, Olga; Corral, Luis Javier Moreno

doi:10.1016/j.nedt.2018.02.005

Cited by 7 publications

(6 citation statements)

References 19 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Importantly, despite this the study has indicated that the use of holographic content to replace or augment traditional aspects of examinations whilst in its infancy is robust. Participants displayed broadly comparable performances compared to traditionally structured exams, consistent with previous data [ 22 ].…”

Section: Discussionsupporting

confidence: 88%

The use of mixed reality technology for the objective assessment of clinical skills: a validation study

et al. 2022

View full text Add to dashboard Cite

Background Mixed Reality technology may provide many advantages over traditional teaching methods. Despite its potential, the technology has yet to be used for the formal assessment of clinical competency. This study sought to collect validity evidence and assess the feasibility of using the HoloLens 2 mixed reality headset for the conduct and augmentation of Objective Structured Clinical Examinations (OSCEs). Methods A prospective cohort study was conducted to compare the assessment of undergraduate medical students undertaking OSCEs via HoloLens 2 live (HLL) and recorded (HLR), and gold-standard in-person (IP) methods. An augmented mixed reality scenario was also assessed. Results Thirteen undergraduate participants completed a total of 65 OSCE stations. Overall inter-modality correlation was 0.81 (p = 0.01), 0.98 (p = 0.01) and 0.82 (p = 0.01) for IP vs. HLL, HLL vs. HLR and IP vs. HLR respectively. Skill based correlations for IP vs. HLR were assessed for history taking (0.82, p = 0.01), clinical examination (0.81, p = 0.01), procedural (0.88, p = 0.01) and clinical skills (0.92, p = 0.01), and assessment of a virtual mixed reality patient (0.74, p = 0.01). The HoloLens device was deemed to be usable and practical (Standard Usability Scale (SUS) score = 51.5), and the technology was thought to deliver greater flexibility and convenience, and have the potential to expand and enhance assessment opportunities. Conclusions HoloLens 2 is comparable to traditional in-person examination of undergraduate medical students for both live and recorded assessments, and therefore is a valid and robust method for objectively assessing performance. The technology is in its infancy, and users need to develop confidence in its usability and reliability as an assessment tool. However, the potential to integrate additional functionality including holographic content, automated tracking and data analysis, and to facilitate remote assessment may allow the technology to enhance, expand and standardise examinations across a range of educational contexts.

show abstract

Section: Discussionsupporting

confidence: 88%

The use of mixed reality technology for the objective assessment of clinical skills: a validation study

et al. 2022

View full text Add to dashboard Cite

show abstract

“…Esta ferramenta foi validada por professores especialistas e demonstrou ser segura para avaliar o desenvolvimento de competência profissional. Os itens do instrumento foram agrupados em três componentes: processo de enfermagem, habilidades de comunicação e gerenciamento de segurança e apresentaram bom conteúdo e houve uma correlação com outras avaliações e notas como registros acadêmicos e outras disciplinas relacionados a competência clínica (CASTRO-YUSTE et al, 2018).…”

Section: Resultsunclassified

A Biomassa De Banana Verde No Combate a Obesidade E Ao Diabetes Mellitus Tipo Ii No Adulto

Costa¹,

Oliveira²,

Lima³

et al. 2021

Dinamismo E Clareza No Planejamento Em Ciências Da Saúde

View full text Add to dashboard Cite

Direitos para esta edição cedidos à Atena Editora pelos autores. Todo o conteúdo deste livro está licenciado sob uma Licença de Atribuição Creative Commons. Atribuição-Não-Comercial-NãoDerivativos 4.0 Internacional (CC BY-NC-ND 4.0).O conteúdo dos artigos e seus dados em sua forma, correção e confiabilidade são de responsabilidade exclusiva dos autores, inclusive não representam necessariamente a posição oficial da Atena Editora. Permitido o download da obra e o compartilhamento desde que sejam atribuídos créditos aos autores, mas sem a possibilidade de alterá-la de nenhuma forma ou utilizá-la para fins comerciais.Todos os manuscritos foram previamente submetidos à avaliação cega pelos pares, membros do Conselho Editorial desta Editora, tendo sido aprovados para a publicação.A Atena Editora é comprometida em garantir a integridade editorial em todas as etapas do processo de publicação. Situações suspeitas de má conduta científica serão investigadas sob o mais alto padrão de rigor acadêmico e ético.

show abstract

“…The authors found sufficient reliability and validity in measuring communication skills and management of patient safety. Reviewing, providing better descriptors, or eliminating items that have that less capacity for discrimination were recommended (Castro-Yuste et al, 2018). Communicating effectively is a core competency of NPs to enhance safe care for patients at the individual and systems levels (NONPF, 2017).…”

Section: Simulation Evaluation Instrumentsmentioning

confidence: 99%

“…In a study of 499 undergraduate nursing students, the Student Assessment Tool for Standardized Patient Simulations was evaluated in relation to student clinical competence with SPs (Castro-Yuste et al, 2018). The authors found sufficient reliability and validity in measuring communication skills and management of patient safety.…”

Section: Introductionmentioning

confidence: 99%

Standardizing nurse practitioner student evaluation during high-stakes clinical examinations

Keiffer

Anderson

Eckhoff

et al. 2020

J Am Assoc Nurse Pract

View full text Add to dashboard Cite

Nurse practitioners (NPs) require clinical competence in advanced health assessment skills to differentiate between normal, variations of normal, and abnormal patient findings. High-stakes clinical examinations, using live hands-on simulation scenarios and standardized patients (SPs) or other human role players, are accepted teaching and evaluation tools for NP students. Providing objective, valid, and reliable feedback to students during high-stakes clinical examinations is of considerable value for ongoing skill development. The study examined opportunities to improve the quality of student evaluation in simulation testing modes. A purposive sample of 17 video recordings of health students' comprehensive examination of an SP or physical examination teaching associate (PETA) from a nursing graduate level health assessment course was evaluated. Using a standardized rubric, students were scored live and after a comprehensive examination of a SP/PETA and via a secure web-based video platform by the faculty and an independent reviewer. Evaluator group examination score comparisons revealed that distributions of examination scores within evaluator groups were not similar. Median examination scores were significantly different between groups; faculty median examination scores significantly higher than SPs/PETAs. Efficiency of student evaluation may be increased by improving reviewer training, reducing checklist length, and adopting electronic scoring. Development of an exemplary teaching video providing explanation and detail for expected student skill performance will allow reviewers to practice and improve competence in reliable scoring, reduce time and effort of scorers, and increase accuracy of scoring.

show abstract

A Student Assessment Tool for Standardized Patient Simulations (SAT-SPS): Psychometric analysis

Cited by 7 publications

References 19 publications

The use of mixed reality technology for the objective assessment of clinical skills: a validation study

The use of mixed reality technology for the objective assessment of clinical skills: a validation study

A Biomassa De Banana Verde No Combate a Obesidade E Ao Diabetes Mellitus Tipo Ii No Adulto

Standardizing nurse practitioner student evaluation during high-stakes clinical examinations

Contact Info

Product

Resources

About