According to a much discussed argument, reliabilism is defective for making knowledge too easy to come by. In a recent paper, Weisberg aims to show that this argument relies on a type of reasoning that is rejectable on independent grounds. We argue that the blanket rejection that Weisberg recommends of this type of reasoning is both unwarranted and unwelcome. Drawing on an older discussion in the philosophy of science, we show that placing some relatively modest restrictions on the said type of reasoning suffices to block the anti-reliabilist argument.Keywords Confirmation theory · Bootstrapping · Easy knowledge According to reliabilists, Reliabilist Tenet (RT) our beliefs can be known, or at least be warranted, even in the absence of warrant for believing that the sources from which they stem are reliable.All that matters for warrant, they claim, is that a belief was in fact reliably formed; for knowledge, one just adds the requirement of truth. Backed by RT, reliabilists have an effective response to one of the most familiar types of skeptic, who challenges the epistemic status of our beliefs by questioning the grounds we have for holding these beliefs, and then goes on to question the grounds of whatever we adduce to our defense. This tactic does not get off the ground against the reliabilist, whose answer simply is that our beliefs can be knowledge, or at least be warranted, whether or not we I. Douven (B)