We study and classify categorical primitive forms for Calabi-Yau A∞-categories with semi-simple Hochschild cohomology, in terms of certain grading operator on its Hochschild homology. We use this result to prove that, if the Fukaya category Fuk(M ) of a symplectic manifold M has semi-simple Hochschild cohomology, then its genus zero Gromov-Witten invariants may be recovered from the A∞-category Fuk(M ) together with the closed-open map. An immediate corollary of this is that in the semi-simple case, homological mirror symmetry implies enumerative mirror symmetry.