The excellent classification accuracy of remote sensory images has led to a major expansion of their use in agricultural field surveillance in recent years. The accurate classification of crop is very significant for agricultural management and food security. There are diverse varieties of crops are available. Among them, each possesses same spectral curves. Due to increasing number of remote sensing information, a major limitation arises in the domain of crop classification is how to determine significant data from huge volume of information to maintain categorization accuracy and implementation time. Consequently, one of the main obstacles in the agricultural industry is the precise classification of crops. Deep Residual Network (ResNet)-based Social Sea Lion Driver Optimization (SSLnDO)-based Deep Fuzzy Clustering (DFC), where the distance is calculated using RV coefficient, are used to develop an effective method for classifying cotton crops. Finally, classification of the cotton crop is successfully accomplished using Deep ResNet, and the network classifier is trained by inserting produced SSLnDO. The vegetation index is generated for each color band independently. Combining the Social Ski Driver (SSD) optimization and the Sea Lion Optimization (SLnO) method yields the newly developed SSLnDO. A maximum testing accuracy of 0.940, a sensitivity of 0.931, and a specificity of 0.926 have been achieved by the designed model. When comparing the accuracy value produced by the proposed method for image-2 to the existing approaches, namely WLI-Fuzzy + BS-Lion NN, OSVM-OCNN, GAN, Hybrid CNN-RF, Deep learning, and Deep ResNet, they are 15.21%, 11.06%, 15.21%, 9.04%, 4.36%, and 2.3% higher.