Enhancing educational technology practical course: Designing and validating tools for evaluating knowledge, performance, and satisfaction of public health students

Abstract

BackgroundThe present study was conducted with the aim of designing and validating questionnaires for evaluating the public health students' knowledge, performance, and satisfaction (KPS) in the course of educational technology.MethodsThe present study was conducted with qualitative‐quantitative approach. Qualitative stage was done based on experts' opinion and related articles and questionnaires for developing, designing, and validating the tools. For validating the tools, face validity and content validity was done based on the opinion of the 10 expert panel. In quantitative stage, all initial validated tools were implemented on 50 students of public health for determining the reliability. The reliability of the tools was calculated using the internal consistency method of the items with Cronbach's ⍺ coefficient, and Kuder–Richardson. All analyses were conducted using SPSS‐19 software.ResultsIn the field of qualitative research, an assessment tool consisting of 20 four‐option questions was designed. The content validity of this tool was confirmed based on the opinions of 10 educational experts, with CVI Total = 0.862 and CVR = 0.885. Additionally, the reliability of the tool was validated through testing on 50 public health students, resulting in a reliability coefficient of r = 0.780. Furthermore, for performance evaluation, four assessment tools each comprising 20 questions (totaling 80 questions) were designed. The validity values for these tools in the areas of PowerPoint (CVI = 0.981, CVR = 0.960), pamphlet (CVI = 0.866, CVR = 0.877), poster (CVI = 0.871, CVR = 0.906), role‐playing (CVI = 0.871, CVR = 0.980), and the reliability of the tools with Cronbach's ⍺ r > 0.80 were confirmed. In the satisfaction assessment section, a researcher‐made questionnaire consisting of 18 questions across seven domains was designed, with confirmed content validity (CVI = 0.949, CVR = 0.861) and reliability (r = 0.928).ConclusionsIt seems that this tool can be used to measure the KPS of students from the educational technology course of the health field and similar fields.