The majority of existing traffic sign detection systems utilize color or shape information, but the methods remain limited in regard to detecting and segmenting traffic signs from a complex background. In this paper, we propose a novel graphbased traffic sign detection approach that consists of a saliency measure stage, a graph-based ranking stage, and a multithreshold segmentation stage. Because the graph-based ranking algorithm with specified color and saliency combines the information of color, saliency, spatial, and contextual relationship of nodes, it is more discriminative and robust than the other systems in terms of handling various illumination conditions, shape rotations, and scale changes from traffic sign images. Furthermore, the proposed multithreshold segmentation algorithm focuses on all the nodes with a nonzero ranking score, which can effectively solve problems such as complex background, occlusion, various illumination conditions, and so on. The results for three public traffic sign sets show that our proposed approach leads to better performance than the current state-of-the-art methods. Moreover, the results are satisfactory even for images containing traffic signs that have been rotated or undergone occlusion, as well as for images that were photographed under different weather and illumination conditions. Index Terms-Graph-based image analysis, graph-based image segmentation, traffic sign detection.