A Generic Binary Tree-Based Progressive Demosaicking Method for Multispectral Filter Array

Abstract

The technique of multispectral filter array (MSFA) is a multispectral extension of the widely deployed color filter array (CFA), which uses single chip sensors and subsequent interpolation strategies to produce full color images. However, multispectral demosaicking presents unique challenges to traditional CFA demosaicking algorithms which cannot be directly extended to deal with various filter arrays with different numbers of spectral bands or different spatial patterns within each band. In addition, the more spectral bands involved, the more sparse each band samples the image plane, and the less information we can utilize when performing the interpolation. In this paper, we study a generic MSFA demosaicking method, which follows a binary tree structure to determine the order according to which different spectral bands and different pixel locations within each band are progressively interpolated, making the edge information utilized more effectively. The proposed method is demonstrated to outperform three traditional interpolation techniques as well as three advanced CFA demosaicking methods using two performance measures, the root mean square error (RMSE) for reconstruction fidelity and the classification accuracy for target recognition performance.

Demosaicing using Dual Layer Feedforward Neural Network

“…Demosaicing exercise on the 5-Band dataset serves more to compare demosaicing algorithms as ground-truth images are available. The authors have already shown their approach using Weighted Guided Filter (WGF) [29] to be better than Binary-Tree Edge Sensing algorithm [25][26][27] therefore we choose not to repeat results for Binary Tree. For this camera, we present results both on rendered images from hyperspectral image databases and also on real RAW images captured with this camera.…”

Median filtering in multispectral filter array demosaicking

“…d) The filter arrays were executed in accordance with the binary tree approach proposed by Miao et al, 2 a perfect binary tree to be exact, with two levels and three levels corresponding to 4-band and 8-band arrangements respectively, as indicated in Figure 5; e) Two demosaicking algorithms, bilinear interpolation and Miao et al's binary tree based progressive demosaicking, 3 were implemented and compared with vector median technique;…”

“…The first notable work in this regard was conducted by Miao et al 2 who developed a generic binary tree based generation method of MSFA spatial arrangement starting from a chequerboard pattern, and further proposed a generic MSFA demosaicking method following the same binary tree structure. 3 To the best of our knowledge, these are the first systematic attempts at MSFA design and demosaicking. This was recently utilised for the further evaluation of the spatial arrangement of filters by Shrestha et al 4 Among a wide spectrum of algorithms proposed for CFA demosaicking in the last decades, some of them might be able to be adapted to MSFA demosaicking due to the intrinsic properties that CFA and MSFA share.…”

Evaluation of the Colorimetric Performance of Single-Sensor Image Acquisition Systems Employing Colour and Multispectral Filter Array

“…In recent years, sustained research effort went into designing multispectral filter array (MSFA) [15] and developing associated demosaicking algorithms [14,1,3,16,17,21,22]. Also widely explored is the influence of filter characteristics on colour/spectrum reproduction [19,9,23,24].…”