The image vectorization based on geometrical contour representation is an active research topic. It involves approximating the contour of the objects inside the image using geometrical definition or estimation. Typical approach of estimating the parameters of the geometrical model is fitting-based estimation. However, the noise that exists in the image causes degradation in the performance. In order to overcome this degradation, we propose integrating evolutionary based optimization. In this article, the design of the operators of the genetic optimization for improving the contour detection results of segments-based estimation of the contour is proposed. The operator includes both crossover and mutation. The evaluation shows that Structural Similarity Index Metrics (SSIM) measure has increased after applying it from 0.64 to 0.77 on UEC Food 100 Dataset and from 0.54 to 0.66 after applying it to UEC Food 256 Dataset.