Background: Ovarian metastases from colorectal cancers are relatively rare. Since most ovarian metastases are associated with metastases at other sites, the prognosis is usually poor. Few reports exist that describe the clinical course of colorectal cancer patients with ovarian metastasis, including the chemotherapy response. Methods: We retrospectively reviewed the clinical data of patients with ovarian metastases from colorectal cancer treated at the National Cancer Center Hospital, Tokyo, between January 2006 and December 2015. Results: Thirty-seven patients with ovarian metastases received palliative chemotherapy as first-line treatment. The objective response rate for systemic chemotherapy of ovarian metastases was significantly lower than that for other metastatic sites (23.5 vs. 63.6% for first-line, respectively, p = 0.0047). Following chemotherapy, the additional surgical resection of ovarian metastases was positively associated with longer overall survival (OS) compared to no surgical resection (43.1 vs. 17.0 months, respectively, p = 0.0016). Furthermore, cytoreductive surgery was also positively associated with longer OS, especially when other metastatic sites were well controlled. Conclusions: Ovarian metastases are less responsive to systemic chemotherapy compared to extra-ovarian metastases in patients with relapsed or metastatic colorectal cancer. Multidisciplinary treatment strategy, including systemic chemotherapy and cytoreductive surgery, may contribute to the prolongation of OS.