Railway track condition has its importance in relation to the driving safety and transport capacity of railways, and its inspection is a crucial task for railway maintenance. Rail wear directly influences wheel-rail contact and the life of rail tracks, so precise and effective inspection of railway wear is a continuous demand. In this paper, a comparison method between point clouds from a structured lightscanner and CAD models of the rail is proposed for railway track wear measurement. With the segmentation algorithm based on Euclidean clustering and random sample consensus (RANSAC), the wheel-rail and non-wheel-rail contact profile are extracted for the alignment. Comparing the measured data and CAD model, random points sampling from CAD models is conducted to generate enough points for the data alignment. In the coarse registration, the curvature of the rail profile is utilized for the point feature histogram (PFH) generation. In the fine registration, the points on non-wheel-rail contact profiles are utilized in the ICP algorithm. To verify the effectiveness of the model comparison, the analysis from software Geomagic Qualify is referenced. It proves that the model comparison method can provide the fundamental support for railway track wear evaluation.