Pathogenic variants in BRCA1 and BRCA2 only explain the underlying genetic cause of about 10% of hereditary breast and ovarian cancer families. Because of cost‐effectiveness, multigene panel testing is often performed even if the clinical utility of testing most of the genes remains questionable. The purpose of our study was to assess the contribution of rare, deleterious‐predicted variants in DNA repair genes in familial breast cancer (BC) in a well‐characterized and homogeneous population. We analyzed 113 DNA repair genes selected from either an exome sequencing or a candidate gene approach in the GENESIS study, which includes familial BC cases with no BRCA1 or BRCA2 mutation and having a sister with BC ( N = 1,207), and general population controls ( N = 1,199). Sequencing data were filtered for rare loss‐of‐function variants (LoF) and likely deleterious missense variants (MV). We confirmed associations between LoF and MV in PALB2 , ATM and CHEK2 and BC occurrence. We also identified for the first time associations between FANCI , MAST1 , POLH and RTEL1 and BC susceptibility. Unlike other associated genes, carriers of an ATM LoF had a significantly higher risk of developing BC than carriers of an ATM MV (OR LoF = 17.4 vs. OR MV = 1.6; p Het = 0.002). Hence, our approach allowed us to specify BC relative risks associated with deleterious‐predicted variants in PALB2 , ATM and CHEK2 and to add MAST1 , POLH , RTEL1 and FANCI to the list of DNA repair genes possibly involved in BC susceptibility. We also highlight that different types of variants within the same gene can lead to different risk estimates.

BackgroundThe ataxia telangiectasia mutated (ATM) gene is a moderate-risk breast cancer susceptibility gene; germline loss-of-function variants are found in up to 3% of hereditary breast and ovarian cancer (HBOC) families who undergo genetic testing. So far, no clear histopathological and molecular features of breast tumours occurring in ATM deleterious variant carriers have been described, but identification of an ATM-associated tumour signature may help in patient management.MethodsTo characterise hallmarks of ATM-associated tumours, we performed systematic pathology review of tumours from 21 participants from ataxia-telangiectasia families and 18 participants from HBOC families, as well as copy number profiling on a subset of 23 tumours. Morphology of ATM-associated tumours was compared with that of 599 patients with no BRCA1 and BRCA2 mutations from a hospital-based series, as well as with data from The Cancer Genome Atlas. Absolute copy number and loss of heterozygosity (LOH) profiles were obtained from the OncoScan SNP array. In addition, we performed whole-genome sequencing on four tumours from ATM loss-of-function variant carriers with available frozen material.ResultsWe found that ATM-associated tumours belong mostly to the luminal B subtype, are tetraploid and show LOH at the ATM locus at 11q22–23. Unlike tumours in which BRCA1 or BRCA2 is inactivated, tumours arising in ATM deleterious variant carriers are not associated with increased large-scale genomic instability as measured by the large-scale state transitions signature. Losses at 13q14.11-q14.3, 17p13.2-p12, 21p11.2-p11.1 and 22q11.23 were observed. Somatic alterations at these loci may therefore represent biomarkers for ATM testing and harbour driver mutations in potentially ‘druggable’ genes that would allow patients to be directed towards tailored therapeutic strategies.ConclusionsAlthough ATM is involved in the DNA damage response, ATM-associated tumours are distinct from BRCA1-associated tumours in terms of morphological characteristics and genomic alterations, and they are also distinguishable from sporadic breast tumours, thus opening up the possibility to identify ATM variant carriers outside the ataxia-telangiectasia disorder and direct them towards effective cancer risk management and therapeutic strategies.Electronic supplementary materialThe online version of this article (10.1186/s13058-018-0951-9) contains supplementary material, which is available to authorized users.