Usability of state public health department websites for communication during a pandemic: A heuristic evaluation

Abstract

Study aims were to investigate how usable COVID-19 dedicated state public health websites in the US were, and whether case counts in different geographical regions in the US were related to website usability. 16 state websites representing the 2 highest and the 2 lowest case count states in each region were selected. Five experts used a heuristic evaluation procedure to independently rate all 16 websites on a severity scale of 0–4. Usability criteria published by the US Department of Health and Human Services and criteria on risk communication and data dashboards were used. Analyses involved cross tabulation of usability criteria with case counts, comparison of usability scores using Mood's median tests, test of differences in average usability scores using ANOVA and post-hoc tests, and identification of correlations between case counts and usability scores. Results from the Mood's median test showed that the median usability scores for the states were significantly different from each other at the 5% level of significance (df = 15, chi-square = 38.40; p = 0.001). ANOVA showed statistically significant differences between the mean usability scores for the states at the 5% level of significance (F = 6.33, p < 0.05) . Although not statistically significant, results from a correlation analysis between case count and usability scores showed a negative correlation (r = -0.209, p = 0.437) indicating that the higher the case count, the better the usability score. Overall, the websites fared well on usability, but many websites were used as an information and data repository. These websites must communicate infection risk better. Relevance to industry The study applies to public health agency websites that communicate essential information during a pandemic.

Individualism, economic development, and democracy as determinants of COVID-19 risk information on 132 government websites

“…Information salience is operationalized as the accessibility of public health messages. Effective frontpage design contributes to user satisfaction and improves salience compared to subsidiary pages ( Yu, 2021 , Momenipour et al, 2021 ). The homepage of a website receives the most page views and is important for user retention ( Top 10 Guidelines for Homepage Usability, 2023 ).…”

Exploration of Digital Health Technologies

“…records, but also on digital applications in the more broad biomedical research domain with relevance to the digitalization of healthcare, for example, social media research with relevance to health and medicine [2], applications of three-dimensional (3D) printing technologies in healthcare [3], use of digital technologies in medical education [4], or research on websites with relevance to public health communication [5], among others. Digital health technologies are set to bring benefits to many healthcare areas.…”

Heuristic Analysis of the Indonesian Covid-19 Official Website Interface

“…Momenipour will conduct a similar study in the United States in 2021 [9]. They conduct heuristic studies for Covid-19-related sites of health facilities or public health agencies.…”