For the selection of the optimal segmentation space of Bayer true color unmanned aerial vehicle image, this paper introduces multi-objectives constraints optimization to solve the inconsistency of multiple indicators. First, the Bayer color images were converted to YIQ(Luninance, Inphase, Quadrature), YCbCr(Luninance, Blue-difference, Red-difference), I 1 I 2 I 3 (Three linear transformed color-opponent dimensions), HSI(Hue, Saturation, Intensity), Nrgb(Normalized Red, Green, Blue) and CIE(L*a*b*) (Comission Internationale de l′Eclairage, L*a*b* for Lightness and two color-opponent dimensions)color space, then the transformed images were segmented with multi-resolution segmentation method. By introducing the multi-objective constraint function, three parameters such as the topology index, geometric index and spectral area matching index were synthetically considered to determine the optimal segmentation scale. Based on that, the multi-objective constraint function was built to comprehensively analyze the result of segmentation, so as to find out the optimal color space for a certain type of building. And then the global optimum color space appropriate for all kinds of buildings can be gained through the comprehensive analysis of the F value of different types of buildings. Finally a series of images of different acquisition conditions and ground features were selected to conduct the test. The result shows that the optimal segmentation color spaces of different types of buildings vary a little. For cottage the I 1 I 2 I 3 space can get the excellent object areas that reflect the real edge of the ground features, while the YCbCr space has some advantages on the segmentation of tile-building. Overall, only I 1 I 2 I 3 color space has better integrated segmentation result for all buildings, and it is considered to be the best color space suitable for segmentation.