In this paper, we present a spectral intrinsic image decomposition (SIID) model, which is dedicated to resolve a natural scene into its purely independent intrinsic components: illumination, shading, and reflectance. By introducing spectral information, our work can solve many challenging cases, such as scenes with metameric effects, which are hard to tackle for trichromatic intrinsic image decomposition (IID), and thus offers potential benefits to many higher-level vision tasks, e.g., materials classification and recognition, shape-from-shading, and spectral image relighting. A both effective and efficient algorithm is presented to decompose a spectral image into its independent intrinsic components. To facilitate future SIID research, we present a public dataset with ground-truth illumination, shading, reflectance and specularity, and a meaningful error metric, so that the quantitative comparison becomes achievable. The experiments on this dataset and other images demonstrate the accuracy and robustness of the proposed method on diverse scenes, and reveal that more spectral channels indeed facilitate the vision task (i.e., segmentation and recognition).
Multispectral images contain many clues of surface characteristics of the objects, thus can be widely used in many computer vision tasks, e.g., recolorization and segmentation. However, due to the complex illumination and the geometry structure of natural scenes, the spectra curves of a same surface can look very different. In this paper, a Low Rank Multispectral Image Intrinsic Decomposition model (LRIID) is presented to decompose the shading and reflectance from a single multispectral image. We extend the Retinex model, which is proposed for RGB image intrinsic decomposition, for multispectral domain. Based on this, a low rank constraint is proposed to reduce the ill-posedness of the problem and make the algorithm solvable. A dataset of 12 images is given with the ground truth of shadings and reflectance, so that the objective evaluations can be conducted. The experiments demonstrate the effectiveness of proposed method.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.