ImportanceThe suicide rate of military servicemembers increases sharply after returning to civilian life. Identifying high-risk servicemembers before they leave service could help target preventive interventions.ObjectiveTo develop a model based on administrative data for regular US Army soldiers that can predict suicides 1 to 120 months after leaving active service.Design, Setting, and ParticipantsIn this prognostic study, a consolidated administrative database was created for all regular US Army soldiers who left service from 2010 through 2019. Machine learning models were trained to predict suicides over the next 1 to 120 months in a random 70% training sample. Validation was implemented in the remaining 30%. Data were analyzed from March 2023 through March 2024.Main outcome and measuresThe outcome was suicide in the National Death Index. Predictors came from administrative records available before leaving service on sociodemographics, Army career characteristics, psychopathologic risk factors, indicators of physical health, social networks and supports, and stressors.ResultsOf the 800 579 soldiers in the cohort (84.9% male; median [IQR] age at discharge, 26 [23-33] years), 2084 suicides had occurred as of December 31, 2019 (51.6 per 100 000 person-years). A lasso model assuming consistent slopes over time discriminated as well over all but the shortest risk horizons as more complex stacked generalization ensemble machine learning models. Test sample area under the receiver operating characteristic curve ranged from 0.87 (SE = 0.06) for suicides in the first month after leaving service to 0.72 (SE = 0.003) for suicides over 120 months. The 10% of soldiers with highest predicted risk accounted for between 30.7% (SE = 1.8) and 46.6% (SE = 6.6) of all suicides across horizons. Calibration was for the most part better for the lasso model than the super learner model (both estimated over 120-month horizons.) Net benefit of a model-informed prevention strategy was positive compared with intervene-with-all or intervene-with-none strategies over a range of plausible intervention thresholds. Sociodemographics, Army career characteristics, and psychopathologic risk factors were the most important classes of predictors.Conclusions and relevanceThese results demonstrated that a model based on administrative variables available at the time of leaving active Army service can predict suicides with meaningful accuracy over the subsequent decade. However, final determination of cost-effectiveness would require information beyond the scope of this report about intervention content, costs, and effects over relevant horizons in relation to the monetary value placed on preventing suicides.
