Performance evaluation on vaccination rates monitoring report system of Shenzhen, China

Abstract

To evaluate the performance of “Vaccination Rates Monitoring Report System” implemented by Shenzhen CDC, we conducted an analysis of the data quality and identify key areas for system improvement. Following evaluation guidelines provided by WHO and United States CDC, we established six evaluation attributes: representativeness, simplicity, acceptability, data reliability, stability and timeliness. In eastern, central and western regions of Shenzhen, we selected one district from each region, of which the local CDC and ten CHSCs under jurisdiction were chosen for evaluation. On-site inspections, questionnaires survey and interviews were utilized for data collection, while the Likert scale method was used for attributes rating evaluation. A total of 70 participants were surveyed, consisting of 60 CHSCs and 10 CDCs staff. The gender ratio was 1:2.5 (males to females), with the majority falling within the 25–34 age range (46%). Most participants held full-time positions (80%) and had more than 5 years of work experience (62%). The system achieved 100% coverage of all CHSCs and CDCs (100%). The cumulative percentage scores for the overall favorable options of simplicity, acceptability, data reliability, stability, and timeliness were 79%, 85%, 73%, 50%, and 71% respectively. The system operates normally with strong representativeness. Acceptability was rated as “good.” Simplicity, data reliability, and system timeliness were rated as “average,” while system stability was rated as “poor.” Based on these survey results, developers should urgently investigate reasons for poor stability, particularly addressing concerns from CHSCs users. Additionally, the issues and shortcomings identified in other attributes should also be gradually improved.