Psychometric Evaluation of a Rubric to Assess Basic Performance During Simulation in Nursing

Abstract

AIM This study was conducted to evaluate the psychometric properties of a rubric to assess nursing student performance in medium- and low-fidelity simulation. METHOD A psychometric study was carried out. Content validity was explored by a group of experts. Internal consistency was determined by means of Cronbach’s coefficient alpha. Interrater agreement and the level of concordance were established by the kappa coefficient and intraclass correlation index. RESULTS The relevance of the dimensions and the definition of each category scored higher than 3.25 on a Likert-type scale (maximum value of 4); content validity ratio values were close to +1. The kappa index was above 0.61 (p < .001) in all dimensions, thereby indicating a good level of interrater agreement; the intraclass correlation index showed values above .82 (p < .001). CONCLUSION The rubric appears to be psychometrically sound, thus supporting its reliability.

Evaluating Reliability of the PRELOAD Rubric: Assessment of Service-Learning Course Syllabi

“…Rubrics are used to assess the performance of activities in a structured way; therefore, testing these properties through multiple studies is important to ensure that they are measuring content in an accurate and consistent manner. Unfortunately, some of the most widely used tools do not undergo psychometric evaluation (Bernat-Adell et al, 2019). S-L is no exception, and therefore it is difficult to compare this novel study with other psychometric assessments in the field.…”

Design of peer assessment rubrics for ICT topics

“…This result showed good agreement between the judges. The rubric's reliability was also calculated using Cronbach's alpha coefficient > 0.82, which was obtained through an internal consistency analysis (Bernat-Adell et al, 2019).…”