Machine learning in the estimation of causal effects: targeted minimum loss-based estimation and double/debiased machine learning

Abstract

Summary In recent decades, the fields of statistical and machine learning have seen a revolution in the development of data-adaptive regression methods that have optimal performance under flexible, sometimes minimal, assumptions on the true regression functions. These developments have impacted all areas of applied and theoretical statistics and have allowed data analysts to avoid the biases incurred under the pervasive practice of parametric model misspecification. In this commentary, I discuss issues around the use of data-adaptive regression in estimation of causal inference parameters. To ground ideas, I focus on two estimation approaches with roots in semi-parametric estimation theory: targeted minimum loss-based estimation (TMLE; van der Laan and Rubin, 2006) and double/debiased machine learning (DML; Chernozhukov and others, 2018). This commentary is not comprehensive, the literature on these topics is rich, and there are many subtleties and developments which I do not address. These two frameworks represent only a small fraction of an increasingly large number of methods for causal inference using machine learning. To my knowledge, they are the only methods grounded in statistical semi-parametric theory that also allow unrestricted use of data-adaptive regression techniques.

G-computation and machine learning for estimating the causal effects of binary exposure statuses on binary outcomes

“…In this paper, we focused on the estimation of a causal effect given that the identifiability conditions were satisfied. In practice, the predictive performance of the Q-model is not sufficient to ensure the absence of bias in the estimation of the causal effect, which requires a precise conceptual knowledge of the causal model 35 .…”

Screening of antibacterial compounds with novel structure from the FDA approved drugs using machine learning methods

“…It is an effective approach by using machine learning methods to predict active antibacterial compounds [ 26 , 28 , 36 ]. The accuracy of the prediction model is affected by many factors, such as the quality of the benchmark datasets [ 37 ], the representative molecular characteristics of the compounds [ 16 ], the applicable machine learning models [ 9 ], and the optimized model parameters [ 38 ]. This study collected a large amount of experimental data on the antibacterial activity of compounds from the ChEMBL and PubChem databases.…”

Estimating heterogeneous survival treatment effect in observational data using machine learning

“…First, while our simulations aimed at providing new empirical evidence about the operating characteristics of state‐of‐the‐art machine learning techniques for estimating TEH with survival data, we only provided frequentist coverage probability for AFT‐BART‐NP because the credible intervals are readily available from the MCMC output. On the other hand, it may be challenging to precisely estimate the variance of the ISTE using DL, RSF, and TSHEE, without resorting to more computationally intensive sample‐splitting methods 2,15,58,59 . Developing and investigating new methods for the variance and interval estimation for frequentist machine learning represent an important avenue for future research.…”