Tooth enamel wear occurs because of daily mastication and occlusion. This study investigated the wear behavior of bovine teeth against aesthetic restorative materials in vitro. Abrader specimens were fabricated using four tooth-colored restorative materials (zirconia, lithium disilicate glass ceramic, dental porcelain, and resin composite), with bovine tooth enamel as a control. Flattened bovine tooth enamel was used as the substrate specimen. These materials were characterized by Vickers hardness tests and surface roughness measurements. Two-body wear tests between the abrader and substrate specimens were performed, and the worn topographies were evaluated using a contour-measuring instrument and 3D laser microscope. The restorative materials and bovine tooth enamel had similar surface roughness but different hardness and wear behaviors. Bovine teeth showed the largest wear in tooth–tooth contact as the abrader and substrate specimens. Compared to bovine teeth, zirconia, lithium disilicate glass ceramic, and dental porcelain showed greater hardness and less wear on their surfaces, and less substrate wear of the opposite tooth enamel. The lowest hardness resin composite showed intermediate wear on its surface, resulting in the lowest substrate wear. Accordingly, dentists should pay attention to the selection of restorative materials to reconstruct their morphologies owing to different wear behaviors.