Kenwick, Vasquez, and Powers (2015) question whether empirical evidence supports the claim that defense pacts deter conflict as prior research (Leeds 2003b; Johnson and Leeds 2011) has concluded. We review the theoretical argument for why defense pacts should deter conflict and consider the challenges inherent in evaluating deterrence using observational data. We then consider whether the research design choices of Kenwick, Vasquez, and Powers improve upon our research design. We demonstrate that claims that defense pacts deter conflict are robust to many of these changes in research design, and we argue that the consequential difference, while perhaps appropriate for testing the Steps to War argument, is not appropriate for testing the deterrent effect of defense pacts. We conclude by noting that a deterrence effect of defense pacts is not necessarily incompatible with aspects of the Steps to War argument (Senese and Vasquez 2008), and we suggest profitable new directions for testing the Steps to War approach.