Website Usability Analysis of U.S. Military Residency Programs

Abstract

Introduction The Military Match is the residency matching system for medical students attending the Uniformed Services University of Health Sciences, and the students were funded by the Health Professions Scholarship Program through the U.S. Army, Air Force, and Navy. To evaluate and compare military residency programs, students use residency program websites. Often, the residency program’s website serves as a key source, or the only point of reference, when considering residency options, especially during times when face-to-face interactions are limited. This report aims to provide a systematic evaluation of military residency programs and their websites. Materials and Methods Utilizing a previously published website usability scoring system, military residency programs were categorized to objectively and quantitatively analyze their websites. Usability was divided into four categories for quantifiable analysis: accessibility, marketing, content quality, and technology. The methodology for this analysis was replicated from published reports that have examined healthcare website usability. Each website was analyzed and scored in four categories: accessibility, content quality, marketing, and technology. A “General Usability” score was calculated for each website using a composite of the key factors within the four categories. An overall score was generated utilizing the weighted percentage across all four categories. To address deficiencies of the original methodology, a secondary analysis was performed on the listed websites utilizing an automated methodology for website usability. Results A comprehensive list of 125 Accreditation Council for Graduate Medical Education U.S. Military residency program websites was compiled. Of these, 96 programs and 106 websites were evaluated. The primary analysis employing usability methodology identified technology as the highest ranked category with a score of 0.749 (SD ± 0.039) (SE 0.005) (P < .05). Marketing and content quality were the lowest scoring categories with mean scores of 0.414 (SD ± 0.054) (SE 0.006) and 0.428 (SD ± 0.229) (SE 0.027), respectively (P < .05). There was no significant difference in overall usability rankings or scores among the 96 residency program websites across the three branches (P < .05). Secondary analysis with the new usability methodology demonstrated military residency websites to exhibit more external backlinking compared to internal backlinking (P < 0.05) and no social media backlinking to any of the 106 analyzed websites. When comparing the three services, the Army had significantly lower external backlinking ranking 43.4 (P < .05) and overall backlinking ranking 56.4 (P < 0.05) when compared to the Navy (mean 48.8 and 71.7, and 43.4). There were no other differences in backlinking rankings across the three branches. Conclusions Residency websites have become a primary way to communicate information to applicants. By assessing the overall usability of the various military residency websites, we determined the effectiveness of these websites to relay information to prospective students interested in applying for military residency. We predict that by improving website accessibility, residency programs increase their effectiveness at communicating information to potential applicants and increase interest in military residency programs.