Reconstruction of MODIS total suspended matter time series maps by DINEOF and validation with autonomous platform data

The Visible Infrared Imaging Radiometer Suite (VIIRS) on the Suomi National Polar-orbiting Partnership (SNPP) and National Oceanic and Atmospheric Administration (NOAA)-20 has been providing a large amount of global ocean color data, which are critical for monitoring and understanding of ocean optical, biological, and ecological processes and phenomena. However, VIIRS-derived daily ocean color images on either SNPP or NOAA-20 have some limitations in ocean coverage due to its swath width, high sensor-zenith angle, high sun glint, and cloud, etc. Merging VIIRS ocean color products derived from the SNPP and NOAA-20 significantly increases the spatial coverage of daily images. The two VIIRS sensors on the SNPP and NOAA-20 have similar sensor characteristics, and global ocean color products are generated using the same Multi-Sensor Level-1 to Level-2 (MSL12) ocean color data processing system. Therefore, the merged VIIRS ocean color data from the two sensors have high data quality with consistent statistical property and accuracy globally. Merging VIIRS SNPP and NOAA-20 ocean color data almost removes the gaps of missing pixels due to high sensor-zenith angles and high sun glint contamination, and also significantly reduces the gaps due to cloud cover. However, there are still gaps of missing pixels in the merged ocean color data. In this study, the Data Interpolating Empirical Orthogonal Functions (DINEOF) are applied on the merged VIIRS SNPP/NOAA-20 global Level-3 ocean color data to completely reconstruct the missing pixels. Specifically, DINEOF is applied to 30 days of daily merged global Level-3 chlorophyll-a (Chl-a) data of 9-km spatial resolution from 19 June to 18 July 2018. To quantitatively evaluate the accuracy of the DINEOF reconstructed data, a set of valid pixels are intentionally treated as “missing pixels”, so that reconstructed data can be compared with the original data. Results show that mean ratios of the reconstructed/original are 1.012, 1.012, 1.015, and 0.997 for global ocean, oligotrophic waters, deep waters, and coastal and inland waters, respectively. The corresponding standard deviation (SD) of the ratios are 0.200, 0.164, 0.182, and 0.287, respectively. Gap-filled daily Chl-a images reveal many large-scale and meso-scale ocean features that are invisible in the original SNPP or NOAA-20 Chl-a images. It is also demonstrated that the gap-filled data based on the merged products show more details in the dynamic ocean features than those based on SNPP or NOAA-20 alone.

Section: Introductionmentioning

confidence: 99%

Filling the Gaps of Missing Data in the Merged VIIRS SNPP/NOAA-20 Ocean Color Product Using the DINEOF Method

Liu

Wang

2019

“…Besides, the societal benefits of ocean color observations include an increased ability to locate potential fishing zones and the ability to monitor water quality and fragile ecosystems [2][3][4][5]. Despite the widespread availability of ocean color observations, mapping of ocean color is spatiotemporally limited and challenged by inconsistent information due to cloud covers [6][7][8][9][10], particularly in polar regions [11,12]. The polar regions are usually covered by dense clouds throughout the year [12], and, thus, the valid range of satellite observations is narrow.…”

Section: Introductionmentioning

confidence: 99%

Reconstruction of Ocean Color Data Using Machine Learning Techniques in Polar Regions: Focusing on Off Cape Hallett, Ross Sea

Park

Kim

et al. 2019

The most problematic issue in the ocean color application is the presence of heavy clouds, especially in polar regions. For that reason, the demand for the ocean color application in polar regions is increased. As a way to overcome such issues, we conducted the reconstruction of the chlorophyll-a concentration (CHL) data using the machine learning-based models to raise the usability of CHL data. This analysis was first conducted on a regional scale and focused on the biologically-valued Cape Hallett, Ross Sea, Antarctica. Environmental factors and geographical information associated with phytoplankton dynamics were considered as predictors for the CHL reconstruction, which were obtained from cloud-free microwave and reanalysis data. As the machine learning models used in the present study, the ensemble-based models such as Random forest (RF) and Extremely randomized tree (ET) were selected with 10-fold cross-validation. As a result, both CHL reconstructions from the two models showed significant agreement with the standard satellite-derived CHL data. In addition, the reconstructed CHLs were close to the actual CHL value even where it was not observed by the satellites. However, there is a slight difference between the CHL reconstruction results from the RF and the ET, which is likely caused by the difference in the contribution of each predictor. In addition, we examined the variable importance for the CHL reconstruction quantitatively. As such, the sea surface and atmospheric temperature, and the photosynthetically available radiation have high contributions to the model developments. Mostly, geographic information appears to have a lower contribution relative to environmental predictors. Lastly, we estimated the partial dependences for the predictors for further study on the variable contribution and investigated the contributions to the CHL reconstruction with changes in the predictors.

“…Among EOF interpolation methods, the Data INterpolating Empirical Orthogonal Functions (DINEOF) technique [9,10] has demonstrated superior results relative to other interpolation methods at diverse levels of cloud coverage [8]. Recent DINEOF applications include spatial reconstructions of satellite-derived time series of sea surface temperature (SST) [2,[11][12][13], sea surface salinity (SSS) [14], chla [15][16][17], turbidity [18], and total suspended matter (TSM) [19], or in multivariate form to exploit natural correlations between variables such as for SST + chla [20,21]. Existing implementations of DINEOF utilize input data at different time scales, for instance, varied study periods and time resolutions (e.g., from less than one year [12] to more than a decade using daily [15] or week composite imagery [16]), for different oceanographic regions, such as open ocean [22] and coastal [23] waters.…”

Section: Introductionmentioning

confidence: 99%

Applications of DINEOF to Satellite-Derived Chlorophyll-a from a Productive Coastal Region

Hilborn

Costa

2018

A major limitation for remote sensing analyses of oceanographic variables is loss of spatial data. The Data INterpolating Empirical Orthogonal Functions (DINEOF) method has demonstrated effectiveness for filling spatial gaps in remote sensing datasets, making them more easily implemented in further applications. However, the spatial and temporal coverage of the input image dataset can heavily impact the outcomes of using this method and, thus, further metrics derived from these datasets, such as phytoplankton bloom phenology. In this study, we used a three-year time series of MODIS-Aqua chlorophyll-a to evaluate the DINEOF reconstruction output accuracy corresponding to variation in the form of the input data used (i.e., daily or week composite scenes) and time series length (annual or three consecutive years) for a dynamic region, the Salish Sea, Canada. The accuracy of the output data was assessed considering the original chla pixels. Daily input time series produced higher accuracy reconstructing chla (95.08–97.08% explained variance, RMSExval 1.49–1.65 mg m−3) than did all week composite counterparts (68.99–76.88% explained variance, RMSExval 1.87–2.07 mg m−3), with longer time series producing better relationships to original chla pixel concentrations. Daily images were assessed relative to extracted in situ chla measurements, with original satellite chla achieving a better relationship to in situ matchups than DINEOF gap-filled chla, and with annual DINEOF-processed data performing better than the multiyear. These results contribute to the ongoing body of work encouraging production of ocean color datasets with consistent processing for global purposes such as climate change studies.