With the rapid development of multimedia technology and network technology and wide application of digital image, more and more attention has been paid for Content-based image retrieval technology. For a long time Xinjiang uygur hospitals and medical institutions accumulated a large amount of underutilized data of uygur medicine. In this paper, the image color histogram feature of botanical and animal drugs of Xinjiang uygur medicine has been extracted . First, the image size has been normalized,and extract the color histogram and analyse color histogram characteristics with statistics method,at last, the classification ability of features is evaluated by Bayes discriminant analysis. Experimental results show that high accuracy for botanical image classification is existed by using color histogram feature. This study would have a certain extent for the content-based medical image retrieval for Xinjiang uygur medicine.