The regression discontinuity (RD) design offers identification of causal effects under weak assumptions, earning it a position as a standard method in modern political science research. But identification does not necessarily imply that causal effects can be estimated accurately with limited data. In this paper, we highlight that estimation under the RD design involves serious statistical challenges and investigate how these challenges manifest themselves in the empirical literature in political science. We collect all RD-based findings published in top political science journals in the period 2009–2018. The distribution of published results exhibits pathological features; estimates tend to bunch just above the conventional level of statistical significance. A reanalysis of all studies with available data suggests that researcher discretion is not a major driver of these features. However, researchers tend to use inappropriate methods for inference, rendering standard errors artificially small. A retrospective power analysis reveals that most of these studies were underpowered to detect all but large effects. The issues we uncover, combined with well-documented selection pressures in academic publishing, cause concern that many published findings using the RD design may be exaggerated.
Can greater inclusion in democracy for historically disadvantaged groups reduce rebel violence? Democracy-building is a common tool in counterinsurgencies and post-conflict states, yet existing scholarship has faced obstacles in measuring the independent effect of democratic reforms. We evaluate whether quotas for Scheduled Tribes in local councils reduced rebel violence in Chhattisgarh, an Indian state featuring high-intensity Maoist insurgent activity. These quotas did not originate as a counterinsurgency technique, but instead as an effort to address the longstanding political marginalization of India’s Scheduled Tribes. We employ a geographic regression discontinuity design to study the wartime effects of quotas implemented in Chhattisgarh, finding that reservations reduced Maoist violence in the state. Exploratory analyses of mechanisms suggest that reservations reduced violence by bringing local elected officials closer to state security forces, providing a windfall of valuable information to counterinsurgents. Our study shows that institutional engineering, like reforms to create more inclusive representative democracy, can shape the trajectory of insurgent violence. Institutional engineering creating more inclusive representative democracy during an ongoing conflict can affect the political economy of information sharing in civil war and, ultimately, affect the trajectory of insurgent violence.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.