Breast cancer is the most frequently diagnosed and the second cause of cancer deaths among women. Several genes are found to be significantly responsible for developing breast cancer. When healthy, these genes act as tumor suppressors by producing a protein that prevents cells from growing uncontrollably. But with mutations and other disorders in these genes, cells can grow quickly and tumors may form. In previous research it has been shown that higher risk of developing breast cancer is associated with having a number of gene mutation, but it is not clear how genetic factors affect the survival pattern in breast cancer patients in the presence of clinical and other relevant factors. In this paper, we consider the joint effect of a number of important genes and relevant clinical factors to study the survival pattern of breast cancer patients using data from The Cancer Genome Atlas (TCGA) project. Among the clinical variables, increasing age, premenopausal status, prior history of cancer and neoplasm status with tumor, Black or African American race and stage IIIA have significantly higher risk of failure (death) from breast cancer. We found significant difference in survival time between altered and non-altered cases in four genes FOXA1, MLH1, RAD50, and RAD51C while considered genetic factors only. After controlling for clinical factors, patients with three mutated genes RAD50, PTEN, and MAP3K1 had higher relative risk of failure from breast cancer.