Indonesia ceramic tiles production is currently ranked between the fifth and sixth of the world, it shows that ceramic tiles is one of the largest commodities in Indonesia. So, ceramic quality becomes very important to be considered for it is used as one of the basic building materials. The existing ceramic testing system in Balai Besar Keramik is performed by the operator repeatedly. With the repetitive performances, they cause fatigue to operator that results in decreased work ability, so in the calibration and readings of measuring instruments an error occurs. To improve the accuracy level of quality control system to remain stable, it's necessary to create an intelligent device that can overcome errors that occur in the inspection process using human vision on the surfaces of defect detection of ceramic tiles that have a high level of system stability; therefore, it is required the automation system design of the image processing-based using Artificial Neural Network method with backpropagation algorithm. The process of system design is using automation design with 300 Lx light intensity, 50 cm of camera distance, based on Artificial Neural Network method with confusion matrix result obtaining accuracy rate of 96.9% for offline mode and 92.3% for realtime mode.