Impoverished and African American fathers are often criticized by policy makers for lack of involvement in their children's lives. These criticisms are limited to defining responsible fatherhood as providing economic support while ignoring other forms of nurturing. Recent studies provide a broader perspective on how impoverished and African American fathers nurture their children. This article analyzes data from five studies carried out in Syracuse, New York, between 1996 and 2011. The studies support the contention that structural violence, inherent in the disproportionate incarceration of African American fathers, is a critical factor impeding the fathers from fulfilling their paternal roles. We discuss policy issues affecting incarcerated fathers that limit the extent to which they are able to bond with their children.