Hyperspectral images (HSIs) are usually corrupted by various noises during the image acquisition process, e.g., Gaussian noise, impulse noise, stripes, deadlines and many others. Such complex noise severely degrades the data quality, reduces the interpretation accuracy of HSIs, and restricts the subsequent HSI applications. In this paper, a spatial non-local and local rank-constrained low-rank regularized Plugand-Play (NLRPnP) model is presented for mixed noise removal in HSIs. Specifically, we first divide HSIs into local overlapping patches. Local rank-constrained low-rank matrix recovery is adopted to effectively separate the low-rank clean HSI patches from the sparse noise and a part of Gaussian noise, and to significantly preserve local structure and detail information in HSIs. Then the spatial non-local based denoiser is introduced to promote the non-local self-similarity and obviously depress the Gaussian noise. Without increasing the difficulty of solving optimization problems, we combine the local and non-local based methods into the Plug-and-Play framework, and develop an efficient algorithm for solving the proposed NLRPnP model by using the alternating direction method of multipliers method. Finally, several experiments are conducted in both simulated and real data conditions to illustrate the better performance of the proposed NLRPnP model than the existing state-of-the-art denoising models. INDEX TERMS Hyperspectral images, denoising, plug-and-play framework, local low-rank matrix recovery, non-local regularization.
Hyperspectral imaging systems that use multispectral filter arrays (MSFA) capture only one spectral component in each pixel. Hyperspectral demosaicing is used to recover the non-measured components. While deep learning methods have shown promise in this area, they still suffer from several challenges, including limited modeling of non-local dependencies, lack of consideration of the periodic MSFA pattern that could be linked to periodic artifacts, and difficulty in recovering high-frequency details. To address these challenges, this paper proposes a novel demosaicing framework, the MSFA-frequency-aware Transformer network (FDM-Net). FDM-Net integrates a novel MSFA-frequency-aware multi-head self-attention mechanism (MaFormer) and a filter-based Fourier zero-padding method to reconstruct high pass components with greater difficulty and low pass components with relative ease, separately. The advantage of Maformer is that it can leverage the MSFA information and non-local dependencies present in the data. Additionally, we introduce a joint spatial and frequency loss to transfer MSFA information and enhance training on frequency components that are hard to recover. Our experimental results demonstrate that FDM-Net outperforms state-of-the-art methods with 6dB PSNR, and reconstructs high-fidelity details successfully.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.