The majority of causative variants in familial breast cancer remain unknown. Of the known risk variants, most are tumor cell autonomous and little attention has been paid yet to germline variants that may affect the tumor microenvironment. In this study, we developed a system called the Consomic Xenograft Model (CXM) to map germline variants that impact only the tumor microenvironment. In CXM, human breast cancer cells are orthotopically implanted into immunodeficient consomic strains and tumor metrics are quantified (e.g., growth, vasculogenesis, and metastasis). Because the strain backgrounds vary, whereas the malignant tumor cells do not, any observed changes in tumor progression are due to genetic differences in the non-malignant microenvironment. Using CXM, we defined genetic variant(s) on rat chromosome 3 that reduced relative tumor growth and hematogenous metastasis in the SS.BN3IL2Rγ consomic model compared to the SSIL2Rγ parental strain. Paradoxically, these effects occurred despite an increase in the density of tumor-associated blood vessels. In contrast, lymphatic vasculature and lymphogenous metastasis were unaffected by the SS.BN3IL2Rγ background. Through comparative mapping and whole genome sequence analysis, we narrowed candidate variants on rat chromosome 3 to six genes with a priority for future analysis. Collectively, our results establish the utility of CXM to localize genetic variants affecting the tumor microenvironment which underlie differences in breast cancer risk.