Ensemble learning of inverse probability weights for marginal structural modeling in large observational datasets

Abstract

Inverse probability weights used to fit marginal structural models are typically estimated using logistic regression. However a data-adaptive procedure may be able to better exploit information available in measured covariates. By combining predictions from multiple algorithms, ensemble learning offers an alternative to logistic regression modeling to further reduce bias in estimated marginal structural model parameters. We describe the application of two ensemble learning approaches to estimating stabilized weights: super learning (SL), an ensemble machine learning approach that relies on V -fold cross validation, and an ensemble learner (EL) that creates a single partition of the data into training and validation sets. Longitudinal data from two multicenter cohort studies in Spain (CoRIS and CoRIS-MD) were analyzed to estimate the mortality hazard ratio for initiation versus no initiation of combined antiretroviral therapy among HIV positive subjects. Both ensemble approaches produced hazard ratio estimates further away from the null, and with tighter confidence intervals, than logistic regression modeling. Computation time for EL was less than half that of SL. We conclude that ensemble learning using a library of diverse candidate algorithms offers an alternative to parametric modeling of inverse probability weights when fitting marginal structural models. With large datasets, EL provides a rich search over the solution space in less time than SL with comparable results.

The impact of adherence to inhaled drugs on 5‐year survival in COPD patients: a time dependent approach

“…The use of optimal study design and statistical approach are critical elements in population‐based studies, like the present work. In order to control for time‐varying confounders when studying time‐varying exposures, marginal structural model (MSM) is considered the preferred method . Given the complex nature of drug exposure measurements in our study, we applied a time‐dependent Cox model.…”

Estimating inverse probability weights using super learner when weight-model specification is unknown in a marginal structural Cox model context

“…Other than the aforementioned works that follow the Young et al . framework , there exit a number of studies that have proposed various other algorithms of simulating data suitable for fitting MSCMs .…”

Quantifying and Reducing Uncertainty about Causality in Improving Public Health and Safety

“…Instead multiple different standard machine-learning algorithms (e.g., logistic regression, random forest, support vector machine, naïve Bayesian classifier, artificial neural network, etc.) are used to predict unobserved values [86] and to estimate IPW weights [37]. These diverse predictions are then combined via weighted averaging, where the weights reflect how well each algorithm predicts known values that have been deliberately excluded (held out for test purposes) from the data supplied to the algorithms -the computational statistical technique known as model cross validation.…”