Multi temporal multispectral UAV remote sensing allows for yield assessment across European wheat varieties already before flowering

Abstract

High throughput field phenotyping techniques employing multispectral cameras allow extracting a variety of variables and features to predict yield and yield related traits, but little is known about which types of multispectral features are optimal to forecast yield potential in the early growth phase. In this study, we aim to identify multispectral features that are able to accurately predict yield and aid in variety classification at different growth stages throughout the season. Furthermore, we hypothesize that texture features (TFs) are more suitable for variety classification than for yield prediction. Throughout 2021 and 2022, a trial involving 19 and 18 European wheat varieties, respectively, was conducted. Multispectral images, encompassing visible, Red-edge, and near-infrared (NIR) bands, were captured at 19 and 22 time points from tillering to harvest using an unmanned aerial vehicle (UAV) in the first and second year of trial. Subsequently, orthomosaic images were generated, and various features were extracted, including single-band reflectances, vegetation indices (VI), and TFs derived from a gray level correlation matrix (GLCM). The performance of these features in predicting yield and classifying varieties at different growth stages was assessed using random forest models. Measurements during the flowering stage demonstrated superior performance for most features. Specifically, Red reflectance achieved a root mean square error (RMSE) of 52.4 g m-2 in the first year and 64.4 g m-2 in the second year. The NDRE VI yielded the most accurate predictions with an RMSE of 49.1 g m-2 and 60.6 g m-2, respectively. Moreover, TFs such as CONTRAST and DISSIMILARITY displayed the best performance in predicting yield, with RMSE values of 55.5 g m-2 and 66.3 g m-2 across the two years of trial. Combining data from different dates enhanced yield prediction and stabilized predictions across dates. TFs exhibited high accuracy in classifying low and high-yielding varieties. The CORRELATION feature achieved an accuracy of 88% in the first year, while the HOMOGENEITY feature reached 92% accuracy in the second year. This study confirms the hypothesis that TFs are more suitable for variety classification than for yield prediction. The results underscore the potential of TFs derived from multispectral images in early yield prediction and varietal classification, offering insights for HTP and precision agriculture alike.

Meta-Analysis Assessing Potential of Drone Remote Sensing in Estimating Plant Traits Related to Nitrogen Use Efficiency

“…This methodology harnesses the inherent strengths of each data compilation, maintaining their full dimensionality to offer an expansive and nuanced perspective on the analyzed phenomena [64]. To date, the majority of work employing multiple sensors take advantage of data integration rather than data fusion [117][118][119], especially imagery data fusion. Different from data integration, data fusion extends this paradigm by engaging in both the integration and condensation of data, which can enhance efficiency and accuracy in representation.…”

An Overview of Machine Learning Applications on Plant Phenotyping, with a Focus on Sunflower

“…The Deep Neural Network (DNN), a more robust and sophisticated model, was used to analyse RGB, multispectral, and thermal images to predict soybean yield [126]. Hyperspectral imaging combined with ML was also applied to classify and predict plants traits, such as salt stress [130], crop yield [131][132][133][134][135][136], and biomass quantity [137][138][139][140]. However, powerful data mining techniques are required.…”

Deep learning-based prediction of plant height and crown area of vegetable crops using LiDAR point cloud

“…In agriculture, they are utilized for tasks such as crop monitoring and data collection through high-resolution aerial imagery. Recent studies have evaluated the use of time-series UAV-based multispectral imagery to predict crop yield at different growth stages at the field level using a range of deep-learning approaches 17 , 18 . Deep learning architectures, such as CNN-LSTM, ConvLSTM, and 3D-CNN, have been compared, with the 3D-CNN architecture outperforming the other two architectures with a coefficient of determination (R 2 ) of 0.96 17 , 18 .…”

“…Recent studies have evaluated the use of time-series UAV-based multispectral imagery to predict crop yield at different growth stages at the field level using a range of deep-learning approaches 17 , 18 . Deep learning architectures, such as CNN-LSTM, ConvLSTM, and 3D-CNN, have been compared, with the 3D-CNN architecture outperforming the other two architectures with a coefficient of determination (R 2 ) of 0.96 17 , 18 . Additionally, DeepCropNet (DCN), a deep learning architecture proposed by 19 , has been utilized for county-level corn yield estimation in the USA from 1981 to 2016 using multi-source remote sensing data, demonstrating the effectiveness of an attention-based LSTM architecture for capturing temporal features.…”