Histogram-based weighted median filtering used for noise reduction of digital elevation model data

Abstract

A new histogram-based robust filter developed for noise reduction of digital elevation model data is presented. When large percentage of data points in data matrices are contaminated with outlier noise, the noise reduction process can give better results than traditional median filtering, if elements with a potentially higher chance of being noise are eliminated by weighting from the input dataset before the median value is calculated. However, on the same matrices, there are likely to be subsets of data where unfiltered input is more reasonable for the calculation. The new method implementing weighting between these two cases is presented below, with its initial tuning and a comparison with both standard median filtering and the Most Frequent Value (MFV) method, as the latter being much more efficient than the usual methods. Following the description of the procedures, their effectiveness is compared for noise reduction in digital elevation model data systems, at various noise levels. The comparison is done mainly by three measures, with most of the focus on the $${L}_{1}$$ L 1 norm data distance results. Finally, a modified version of the method—which includes Steiner’s MFV filter as a core part—is also introduced, with similar examination. The method to be presented has been shown to be superior to conventional median filtering for most noise rates, and in many cases also to Steiner' MFV, for handling non-zero mean noises. The modified version of the method—with the help of Steiner's MFV—has also achieved this in handling zero mean noise, in the field of application described in the paper.

Hyperspectral Image Classification Using Improved Active Deep Learning Framework Including Edge Preserving Filters

“…Note that hyperparameters about both active learning process and different edge preserving filters are shared in Table 1 and Table 2, respectively. More information can be found from the related references (Yang et al, 2024;Kilik, 2021;Min et al, 2014;Kotwal & Chaudhuri, 2010;Ham et al, 2015).…”

“…It's useful for preserving image edges and structures. And eliminating outlier noise in data matrices, especially if a high percentage of the matrix points are contaminated with outlier noise (Kilik, 2021). 3.…”

Robust reservoir identification by multi-well cluster analysis of wireline logging data

“…We optimize the selection of the initial centroids by narrowing their possible ranges using a histogram-based selection method proposed in Ref. [ 45 ]. The core of the multi-step process is based on the sorting of the elements and then calculating the weighted mean of elements to correct their central value at each position of a moving window going through the dataset.…”

“…The weights expressing the relative contribution of the two individual MFV methods are set empirically, and the quality of initialization can be checked as described in detail in Ref. [ 45 ].…”

“…This technique works well for noisy and missing datasets as demonstrated. Then, we reduce the initial model dependence of clustering by setting the centroids by a histogram-based weighted median filtering method suggested originally for noise reduction in modeling digital elevation data [ 45 ]. We apply the same technique to narrow the possible range of candidate solutions and find proper starting centroids to get an optimal solution.…”