Blood pressure is a modifiable risk for cardiovascular disease (CVD). Among hemodialysis patients, there is a U-shaped association between blood pressure and risk of death. However, few studies have examined the association between blood pressure and CVD in patients with stage 4 and 5 chronic kidney disease. Here we studied 1,795 Chronic Renal Insufficiency Cohort (CRIC) Study participants with estimated glomerular filtration rate under 30 ml/min/1.73 m2 and not on dialysis. The association of systolic (SBP), diastolic (DBP) and pulse pressure with risk of physician-adjudicated atherosclerotic CVD (stroke, myocardial infarction or peripheral arterial disease) and heart failure were tested using Cox regression adjusted for demographics, comorbidity and medications. There was a significant association with higher SBP (adjusted hazard ratio 2.04 [95% confidence interval: 1.46, 2.84]) for SBP over 140 vs under 120 mmHg, higher DBP (2.52 [1.54, 4.11]) for DBP over 90 vs under 80 mmHg and higher pulse pressure (2.67 [1.82, 3.92]) for pulse pressure over 68 vs under 51 mmHg with atherosclerotic CVD. For heart failure, there was a significant association with higher pulse pressure only (1.42 [1.05, 1.92]) for pulse pressure over 68 vs under 51 mmHg, but not for SBP or DBP. Thus, among participants with stage 4 and 5 chronic kidney disease, there was an independent association between higher SBP, DBP and pulse pressure with risk of atherosclerotic CVD, while only higher pulse pressure was independently associated with greater risk of heart failure. Further trials are needed to determine whether aggressive reduction of blood pressure reduces the risk of CVD events in patients with stage 4 and 5 chronic kidney disease.