This research paper focuses on the innovative detection of defects in fabric. This approach is based on the design and development of a computer-assisted system using the deep learning technique. The classification network is modeled using the ResNet512-based Convolutional Neural Network to learn the deep features in the presented fabric. Being an accurate method, this enables accurate localization of minute defects too. Our classification is based on three major steps; firstly, an image acquired by the NI Vision model and pre-processed for a standard pattern to Kullback Leibler Divergence calculation. Secondly, standard textile fabrics are presented to train the Convolutional Neural Network to classify the defective region and the defect-free region. Finally, the testing fabrics are examined by the trained deep Convolutional Neural Network algorithm. To verify the performance, multiple fabrics are presented and the classification accuracy is evaluated. For standard defects on defective fabrics, an average accuracy of 96.5% with 98.5% precision is obtained. Experimental results on the standard Textile Texture Database dataset confirmed that our method provides better results compared with similar recent classification methods, such as the Support Vector Machine and Bayesian classifier.