Purpose This study aims to (1) examine the prevalence of painful versus non-painful chemotherapy-induced peripheral neuropathy (CIPN) among long-term colorectal cancer (CRC) survivors, (2) identify sociodemographic, clinical, and psychological factors associated with painful and non-painful CIPN, and (3) examine the associations of painful CIPN with health-related quality of life (HRQoL) in comparison with non-painful CIPN, i.e., numbness/tingling. Methods All CRC survivors diagnosed between 2000 and 2009 as registered by the population-based Netherlands Cancer Registry (Eindhoven region) were eligible for participation. Chemotherapy-treated survivors (n = 477) completed questions on CIPN (EORTC QLQ-CIPN20) and HRQoL (EORTC QLQ-C30). Results Painful CIPN was reported by 9% (n = 45) of survivors and non-painful CIPN was reported by 22% (n = 103). Time since diagnosis was related to painful CIPN, and time since diagnosis, a higher disease stage, osteoarthritis, and more anxiety symptoms were related to non-painful CIPN. Finally, survivors with painful CIPN reported a worse global quality of life and worse physical, role, cognitive, and social functioning compared to survivors with non-painful CIPN and those without any sensory CIPN. No differences were found between survivors with non-painful CIPN and those without sensory CIPN. Conclusions It seems that painful CIPN must be distinguished from non-painful CIPN, as only painful CIPN was related to a worse HRQoL. Future research is needed to examine whether painful CIPN must be distinguished from non-painful CIPN regarding predictors, mechanisms, and treatment.