In digital images, edges characterize object boundaries, then their detection remains a crucial stage in numerous applications. To achieve this task, many edge detectors have been designed, producing different results, with different qualities. Evaluating the response obtained by these detectors has become a crucial task. In this paper, several referenced-based boundary detection evaluations are detailed, pointing their advantages and disadvantages through concrete examples of edge images. Then, a new supervised edge map quality measure is proposed, comparing a ground truth contour image, the candidate contour image and their associated spacial nearness. Compared to other boundary detection assessments, this new method has the advantage to be normalized and remains a more reliable edge map quality measure.