Due to the increasing usage of multimedia and storage devices accessible, searching for large image databases has become imperative. Furthermore, the handiness of high-speed internet has escalated the exchange of images by users enormously. Content-Based Image Retrieval is proposed in this work, taking features based on Exact Legendre Moments, HVS color quantization with dc coefficient and statistical properties such as variance, mean, and skew of Conjugate Symmetric Sequency Complex Hadamard Transform (CS-SCHT). In most of the machine learning tasks, the quality of the learning process depends on dimensionality. High dimensional datasets can influence the classification outcome and training time. To overcome this problem, we use DE (Differential Evolution) to generate the optimal feature subsets. The features scaled by weights derived from the firefly algorithm, which fed to Multi-Class SVM. The fitness function taken for the firefly algorithm is the classification error of SVM. By minimizing fitness function, optimum weights are obtained. When these optimal weights are applied to SVM, the proposed algorithm exhibits better precision, recall, and accuracy when compared to some of the existing algorithms in the literature.