Sex-differential selection (SDS), which occurs when the fitness effects of alleles differ between males and females, can have profound impacts on the maintenance of genetic variation, disease risk, and other key aspects of natural populations. Because the sexes mix their autosomal genomes each generation, quantifying SDS is not possible using conventional population genetic approaches. Here, we introduce a novel method that exploits subtle sex differences in haplotype frequencies resulting from SDS acting in the current generation. Using data from 300K individuals in the UK Biobank, we estimate the strength of SDS throughout the genome. While only a handful of loci under SDS are individually significant, we uncover polygenic signals of genome-wide SDS for both viability and fecundity. An interesting life-history tradeoff emerges: alleles that increase viability more in one sex increase fecundity more in the other sex. Lastly, we find evidence of SDS on fecundity acting on alleles affecting arm fat-free mass. Taken together, our findings connect the long-standing evidence of SDS acting on human phenotypes with its impact on the genome.