Agent-based simulations are widely used nowadays in public health research for comparing different strategies for mitigating epidemics and for planning appropriate responses in the aftermath of crises in large urban areas because they can capture fine scale heterogeneities that may have important non-linear effects on the results. Given the costs of implementing strategies, decision-makers have to be convinced that the proposed treatment/procedure leads to a statistically significant improvement.
This paper presents an innovative method for constructing paired agent-based simulations where exactly the same set of random effects is applied to simulations with and without the treatment/procedure. Statistical Analysis of Variance distinguishes the sum of squares between groups (BSS) from the sum of squares within groups (WSS). Our aim was to filter out the within sum of squares (WSS) leaving only the sum of squares between the control group and the treatment group (BSS). We propose to filter out the WSS by constructing paired simulations because as is well known, when paired t-tests can be used, they are much more powerful than ordinary t-tests. Pearson's Chi-squared goodness of fit, the Kolmogorov-Smirnov statistic and the Kullback-Leibler Divergence are then used to test whether the effect is statistically significant. This procedure has been tested on a case-study on the propagation of the Zika epidemic in Rio de Janeiro in 2015.