Development and Validation of a New Tool to Measure Performance Knowledge and Communication Skill of Multidisciplinary Health Science Learners on Radiation Emergency Preparedness and Response Management

Abstract

Objective: The purpose of the study was to design, develop, and validate a newer tool on radiation emergency preparedness responses (RadEM-PREM IPE tool) to measure communication, knowledge, performance skills in multidisciplinary health science learners. Methods: The study design is a prospective, single centric, pilot study. Five subject experts designed, analyzed, and selected items of the instrument for relevant content and domain. Psychometrics that the tool assessed were content validity, internal consistency, test-retest reliability, and intraclass correlation coefficient. Twenty-eight participants completed test-retest reliability for validation of 21 sorted out items calculated percentage of agreement >70% I-CVI/UA (item content validity index with universal acceptability) and S-CVI/UA (scale content validity index with universal agreement method). Results: Items with percentage agreement >70% and I-CVI over 0.80 were kept, ranged from 0.70 to 0.78 were revised, and below 0.70 were rejected. Items with kappa values ranging from 0.04 to 0.59 were revised and ≥0.74 were retained. Internal consistency assessed using Cronbach’s alpha was 0.449. Positive correlation between attitude and communication (r = 0.448), between performance and communication (r = 0.443) were statistically significant at 0.01 level. Overall, intraclass correlation coefficient for all the measures is 0.646, which is statistically significant at 0.05 level (P < 0.05). Conclusions: Study concludes that the RadEM-PREM IPE tool would be a new measuring tool to assess knowledge, performance, and communication skills of interprofessional radiation emergency response team learner’s evaluation.