Enhanced Convolutional-Neural-Network Architecture for Crop Classification

Abstract

Automatic crop identification and monitoring is a key element in enhancing food production processes as well as diminishing the related environmental impact. Although several efficient deep learning techniques have emerged in the field of multispectral imagery analysis, the crop classification problem still needs more accurate solutions. This work introduces a competitive methodology for crop classification from multispectral satellite imagery mainly using an enhanced 2D convolutional neural network (2D-CNN) designed at a smaller-scale architecture, as well as a novel post-processing step. The proposed methodology contains four steps: image stacking, patch extraction, classification model design (based on a 2D-CNN architecture), and post-processing. First, the images are stacked to increase the number of features. Second, the input images are split into patches and fed into the 2D-CNN model. Then, the 2D-CNN model is constructed within a small-scale framework, and properly trained to recognize 10 different types of crops. Finally, a post-processing step is performed in order to reduce the classification error caused by lower-spatial-resolution images. Experiments were carried over the so-named Campo Verde database, which consists of a set of satellite images captured by Landsat and Sentinel satellites from the municipality of Campo Verde, Brazil. In contrast to the maximum accuracy values reached by remarkable works reported in the literature (amounting to an overall accuracy of about 81%, a f1 score of 75.89%, and average accuracy of 73.35%), the proposed methodology achieves a competitive overall accuracy of 81.20%, a f1 score of 75.89%, and an average accuracy of 88.72% when classifying 10 different crops, while ensuring an adequate trade-off between the number of multiply-accumulate operations (MACs) and accuracy. Furthermore, given its ability to effectively classify patches from two image sequences, this methodology may result appealing for other real-world applications, such as the classification of urban materials.

Mapping Agricultural Intensification in the Brazilian Savanna: A Machine Learning Approach Using Harmonized Data from Landsat Sentinel-2

“…Studies applying an ANN for LULC classification found that when compared with other models, especially the ones based on decision trees, the ANN tends to present a lower performance , which can be associated with its limited number of hidden layers. The use of convolutional and recurrent neural networks (CNNs and RNNs, respectively) has been suggested to solve this ANN problem [69]. However, the computational cost can be high, mainly when the time series of high-resolution images are involved.…”

The Development of Peanut Defect Detection Technique Using Hyperspectral Images

“…Rustowicz et al [38]mentioned that applying 2DCNN to crops has a considerable level. Moreno-Revelo et al [39] used tens of plant types for classification with good accuracy. Toraman [40] used it for predicting epileptic attacks and identifying ongoing seizures.…”

Crop-Planting Area Prediction from Multi-Source Gaofen Satellite Images Using a Novel Deep Learning Model: A Case Study of Yangling District

“…This enables efficient and real-time crop identification [10][11][12][13][14][15][16][17][18][19][20]. Among them, machine learning (ML) and deep learning (DL) [21][22][23][24][25][26][27][28] methods have been proven effective in extracting agricultural information from remote sensing data. These methods (ML and DL) utilize feature learning to achieve target classification, leading to improved information extraction results.…”