A variational pan-sharpening algorithm to enhance the spectral and spatial details

Gogineni, Rajesh; Chaturvedi, Ashvini; Sagar, B. S. Daya

doi:10.1080/19479832.2020.1838629

Cited by 11 publications

(4 citation statements)

References 44 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, this ideal seamless situation usually does not exist in practice. In addition, some image fusion methods can mitigate intensity differences and minor structural misalignments around the seam‐line (Anat et al., 2004; Brown & Lowe, 2007; Gogineni et al., 2020).…”

Section: Related Workmentioning

confidence: 99%

Real‐time generation of spherical panoramic video using an omnidirectional multi‐camera system

Gao,

Wu,

Huang

et al. 2024

The Photogrammetric Record

View full text Add to dashboard Cite

This paper presents a novel method for real‐time generation of seamless spherical panoramic videos from an omnidirectional multi‐camera system (OMS). Firstly, a multi‐view video alignment model called spherical projection constrained thin‐plate spline (SP‐TPS) was established and estimated using an approximately symmetrical seam‐line, maintaining the structure inconsistency around the seam‐line. Then, a look‐up table was designed to support real‐time processing of video re‐projection, video dodging and seam‐line updates. In the table, the overlapping areas in OMS multi‐view videos, the seam‐lines between spherical panoramas and OMS multi‐view videos and the pixel coordinate mapping relationship between spherical panoramas and OMS multi‐view videos were pre‐stored as a whole. Finally, a spherical panoramic video was outputted in real‐time through look‐up table computation under an ordinary GPU processor. The experiments were conducted on multi‐view video taken by “1 + 4” and “1 + 7” OMS, respectively. Experimental results demonstrate that compared with four state‐of‐the‐art methods reported in the literature and two bits of commercial software for video stitching, the proposed method excels in eliminating visual artefacts and demonstrates superior adaptability to scenes with varying depths of field. Assuming that OMS is not movable in the scene, this method can generate seamless spherical panoramic videos with a resolution of 8 K in real time, which is of great value to the surveillance field.

show abstract

Section: Related Workmentioning

confidence: 99%

Real‐time generation of spherical panoramic video using an omnidirectional multi‐camera system

Gao,

Wu,

Huang

et al. 2024

The Photogrammetric Record

View full text Add to dashboard Cite

show abstract

“…Zheng et al (2018) proposed using DSM to guide the seam-line, initialised with Voronoi diagrams, not to pass through buildings and trees. Because an ideal seam-line does not exist in practice, some advanced composition methods, such as multi-band blending (Brown & Lowe, 2007), gradient domain fusion (Levin et al, 2004) and variational pan-sharpening (Gogineni et al, 2020), are often adopted and capable of handling the ghosting artefact around the seam to a certain extent by blurring discontinuous edges, but they are more suitable for eliminating intensity differences and very small structural misalignment.…”

Section: Image Mosaicmentioning

confidence: 99%

Real‐time mosaic of multiple fisheye surveillance videos based on geo‐registration and rectification

Gao

2023

The Photogrammetric Record

View full text Add to dashboard Cite

A distributed fisheye video surveillance system (DFVSS) can monitor a wide area without blind spots, but it is often affected by the viewpoint discontinuity and space inconsistency of multiple videos in the area. This paper proposes a novel real‐time fisheye video mosaic algorithm for wide‐area surveillance. First, by extending the line photogrammetry theory under central projection to spherical projection, a fisheye video geo‐registration model is established and estimated using orthogonal parallel lines on the ground, so that all videos of DFVSS are in the unified reference system to eliminate the space inconsistency between them. Second, by combining the photogrammetry orthorectification technique with thin‐plate spline transformation, a fisheye video rectification model is established to eliminate serious distortion in geo‐registered fisheye videos and align them accurately. Third, the viewport‐dependent video selection strategy and video look‐up table computation technique are adopted to create a high‐resolution panorama from input fisheye videos in real time. A parking lot of about 0.4 km2 monitored by eight fisheye cameras was selected as the test area. The experimental result shows the line re‐projection error in fisheye videos is about 0.5 pixels, and the overall efficiency, including panorama creation and mapping to the ground as texture, is not <30 fps. It indicates that the proposed algorithm can achieve a good balance between the limitation of video transmission bandwidth and the smooth observation requirement of computer equipment for the panorama, which is of great value for the construction and application of DFVSS.

show abstract

“…[34] proposed l1 regularization term instead of variational regularization, with the use of l1 regularization it encourages features of sparse representation to improve the spatial fidelity of the HRMS image. New total generalised variation (TGV) based prior term is proposed by [35] to inject geometric features of PAN image into pansharpened image with the use of efficient operator splitting framework. Many variational pansharpening methods succeeds in preserving spectral details but resultant image has spatial artifacts like blocks and blurring so there is need of variational model which can preserve spatial and spectral information.…”

Section: Introductionmentioning

confidence: 99%

Remote Sensing Pansharpening with TV-H−1 Decomposition and PSO-Based Adaptive Weighting Method

Sangani¹,

Thakker

Panchal

et al. 2023

Int. J. Image Grap.

View full text Add to dashboard Cite

In remote sensing, owing to existing sensors’ limitations and the tradeoff between signal-to-noise ratio (SNR) and instantaneous field of view (IFOV), it is difficult to obtain a single image with good spectral and spatial resolution. Pansharpening (PS) is the technique for sharpening multispectral (MS) images by extracting structural and edge information of panchromatic (PAN) image. Multiscale decomposition methods are used for decomposing image in sub-bands but are affected by ringing artifacts, therefore the resultant image seems to be blurred and misregistered. The proposed method overcomes this drawback by decomposing PAN and four band MS image into cartoon and texture components with total variation (TV) Hilbert[Formula: see text] model. The particle swarm optimization (PSO) algorithm is used for finding the optimum weight for fusing texture and cartoon details of PAN and MS images. The proposed method is practically validated on both full-scale and reduced-scale. Robustness of our proposed approach is tested on different geographical areas such as hilly, urban, and vegetation areas. From the visual analysis and qualitative parameters, the proposed method is proved effective compared with other traditional approaches.

show abstract

A variational pan-sharpening algorithm to enhance the spectral and spatial details

Cited by 11 publications

References 44 publications

Real‐time generation of spherical panoramic video using an omnidirectional multi‐camera system

Real‐time generation of spherical panoramic video using an omnidirectional multi‐camera system

Real‐time mosaic of multiple fisheye surveillance videos based on geo‐registration and rectification

Remote Sensing Pansharpening with TV-H−1 Decomposition and PSO-Based Adaptive Weighting Method

Contact Info

Product

Resources

About