Bidimensional Multivariate Empirical Mode Decomposition With Applications in Multi-Scale Image Fusion

Abstract

Empirical mode decomposition (EMD) is a fully data-driven technique designed for multiscale decomposition of signals into their natural scale components, called intrinsic mode functions (IMFs). When EMD is directly applied to perform fusion of multivariate data from multiple and heterogeneous sources, the problem of uniqueness, that is, different numbers of decomposition levels for different sources, is likely to occur, due to the empirical nature of EMD. Although the multivariate EMD (MEMD) has been proposed for temporal data, which employs real-valued projections along multiple directions on a unit hypersphere in the n-dimensional space to calculate the envelope and the local mean of multivariate signals, in order to guarantee the uniqueness of the scales, its direct usefulness in 2D multi-scale image fusion is still limited, due to its inability to maintain the spatial information. To address this issue, we propose a novel bidimensional MEMD (BMEMD) which directly projects a bidimensional multivariate signal, which is composed of multiple images, on the unit hypersphere in the n-dimensional space. This is achieved via real-valued surface projections and the mean surface is estimated by interpolating the multivariate scatter data so as to extract common spatio-temporal scales across multiple images. Case studies involving texture analysis and multi-focus image fusion are presented to demonstrate the effectiveness of the proposed method. INDEX TERMS Empirical mode decomposition (EMD), bidimensional multivariate EMD (BMEMD), realvalued surface projections, multi-scale image fusion.

MEMD-Based Hybrid Modal Identification for High-Rise Structures with Multi-Sensor Vibration Measurements

“…To yield a more uniform distribution of directional vectors, the low-discrepancy sequences [22], including the Halton and Hammersley sequences are adapted to generate the directional vectors. The main procedures of the MEMD method can be listed in the following steps [14,[23][24][25]:…”

Discerning the painter’s hand: machine learning on surface topography

“…[18-20] Its versatility is derived from its data-driven methodology, relying on unbiased techniques for ltering data into intrinsic mode functions (IMFs) that characterize the signal's innate frequency composition. [21] In our case, we have used a bi-directional multivariate EMD [22] to split our 3D reconstruction of each painting's complex surface structure into IMFs that characterize the various spatial scales present.…”

Bootstrap Empirical Mode Decomposition with Application to CIELAB Color Images

“…Rehman et al [47] extended MEMD to 2D by stacking the pixels into a 1D column. Xia et al [48] proposed a bidimensional MEMD for multi-focus image sets by direct projection and envelope computation on a 2D support. These methods employ sifting.…”