Primer on Statistical Interpretation or Methods Report Card on Propensity-Score Matching in the Cardiology Literature From 2004 to 2006

Abstract

Background-Propensity-score matching is frequently used in the cardiology literature. Recent systematic reviews have found that this method is, in general, poorly implemented in the medical literature. The study objective was to examine the quality of the implementation of propensity-score matching in the general cardiology literature. Methods and Results-A total of 44 articles published in the American Heart Journal, the American Journal of Cardiology, Circulation, the European Heart Journal, Heart, the International Journal of Cardiology, and the Journal of the American College of Cardiology between January 1, 2004, and December 31, 2006, were examined. Twenty of the 44 studies did not provide adequate information on how the propensity-score-matched pairs were formed. Fourteen studies did not report whether matching on the propensity score balanced baseline characteristics between treated and untreated subjects in the matched sample. Only 4 studies explicitly used statistical methods appropriate for matched studies to compare baseline characteristics between treated and untreated subjects. Only 11 (25%) of the 44 studies explicitly used statistical methods appropriate for the analysis of matched data when estimating the effect of treatment on the outcomes. Only 2 studies described the matching method used, assessed balance in baseline covariates by appropriate methods, and used appropriate statistical methods to estimate the treatment effect and its significance.

A Tutorial on Methods to Estimating Clinically and Policy-Meaningful Measures of Treatment Effects in Prospective Observational Studies: A Review

“…Estimates of treatment effect are estimated in the resultant matched sample. Propensity-score matching is frequently used in the medical literature (Austin, 2007a(Austin, , 2008a(Austin, , 2008b. Stratification on the propensity score stratifies the original sample according to the values of the propensity score.…”

Mitral Repair versus Replacement for Ischemic Mitral Regurgitation

“…In addition, 2 groups of 104 patients receiving either MVRp or MVR were matched on a 1:1 basis according to propensity score using nearest neighbor method with a caliper of 0.01. 9 As appropriate, the impact of the type of surgery on operative and overall mortality was obtained using McNemar's test and stratified univariate Cox model, respectively. 9…”

Tools & Techniques - Statistics: Propensity score techniques

“…Callipers should not be chosen too narrow, since this will lead to an unnecessary loss of observations. Matching should be accounted for in the analysis, such as the use of a Cox proportional hazards model for time to event data stratified by matched pairs 18 , or conditional logistic regression for binary data. Figure 3 presents the distribution of PS after 1:1 matching.…”