Development of a scalable image formation pipeline for multiscale gigapixel photography

Golish, D. R.; Vera, Esteban; Kelly, Kevin; Gong, Qian; Jansen, Peter; Hughes, John M.; Kittle, David S.; Brady, David J.; Gehm, Michael E.

doi:10.1364/oe.20.022048

Cited by 28 publications

(7 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Since the introduction of gigapixel imagery [KUDC07], advances in the algorithms that drive their processing have allowed massive mosaics to reach terapixels [KSH10] in size and even incorporate video into the composition [HLSH17]. Their construction often requires specialized hardware [KUDC07, CMN11, BH09, BGS*12, GVK*12] with the most common being a robotic panoramic tripod head [Gig10] with an attached camera set to its maximum zoom.…”

Section: Related Workmentioning

confidence: 99%

Adaptive Compositing and Navigation of Variable Resolution Images

Licorish

Faraj

Summa

2020

Computer Graphics Forum

View full text Add to dashboard Cite

We present a new, high‐quality compositing pipeline and navigation approach for variable resolution imagery. The motivation of this work is to explore the use of variable resolution images as a quick and accessible alternative to traditional gigapixel mosaics. Instead of the common tedious acquisition of many images using specialized hardware, variable resolution images can achieve similarly deep zooms as large mosaics, but with only a handful of images. For this approach to be a viable alternative, the state‐of‐the‐art in variable resolution compositing needs to be improved to match the high‐quality approaches commonly used in mosaic compositing. To this end, we provide a novel, variable resolution mosaic seam calculation and gradient domain color correction. This approach includes a new priority order graph cuts computation along with a practical data structure to keep memory overhead low. In addition, navigating variable resolution images is challenging, especially at the zoom factors targeted in this work. To address this challenge, we introduce a new image interaction for variable resolution imagery: a pan that automatically, and smoothly, hugs available resolution. Finally, we provide several real‐world examples of our approach producing high‐quality variable resolution mosaics with deep zooms typically associated with gigapixel photography.

show abstract

Section: Related Workmentioning

confidence: 99%

Adaptive Compositing and Navigation of Variable Resolution Images

Licorish

Faraj

Summa

2020

Computer Graphics Forum

View full text Add to dashboard Cite

show abstract

“…In such cases the stitched image must be decomposed into "tile" components for interactive display. In the case of the AWARE cameras, a model-based architecture was created to use the pull data from microcamera streams at the video rate to compose the real-time display [56,57] without forming a completely stitched image. More recently, the Aqueti Mantis array cameras included a wide FoV camera along with the narrow field array.…”

Section: Image Composition and Displaymentioning

confidence: 99%

Parallel cameras

Brady¹,

Pang²,

Li³

et al. 2018

Optica

View full text Add to dashboard Cite

Parallel lens systems and parallel image signal processing enable cost efficient and compact cameras to capture gigapixel scale images. This paper reviews the context of such cameras in the developing field of computational imaging and discusses how parallel architectures impact optical and electronic processing design. Using an array camera operating system initially developed under the Defense Advanced Research Projects Agency Advanced Wide FOV Architectures for Image Reconstruction and Exploitation program, we illustrate the state of parallel camera development with example 100 megapixel videos.

show abstract

“…With the advancement of information technology, people are becoming more interested in acquiring more detailed information from the external environment. The amount of information obtained by an optical system is chiefly determined by two factors: field of view (FOV) and resolution [ 1 , 2 ], where a large FOV can cover a wide observation range and a high resolution can help to capture more detailed information about the observed object. However, there is a mutually restrictive relationship between these two factors, and to balance the trade-off between a large FOV and high resolution, the concentric multi-scale optical system was born [ 3 , 4 , 5 ].…”

Section: Introductionmentioning

confidence: 99%

Design of a Concentric Multi-Scale Zoom Optical System Based on Wide Object Distance and High-Precision Imaging

Zhang

Qin

et al. 2022

Sensors

View full text Add to dashboard Cite

To effectively balance the trade-off between a large field of view (FOV) and high resolution of an optical system, as well as to solve the problem of image stitching misalignment after focusing, firstly, this paper conducts a theoretical analysis of the design principle of the concentric multi-scale optical system and the causes of image stitching misalignment after focusing. Secondly, the design idea of using a combination structure of a two-layer front concentric imaging group and an image-space telecentric relay imaging array and then a joint full-motion zoom relay imaging system is proposed. Finally, an image-space telecentric two-step zoom concentric multi-scale optical system with a 7 × 7 relay imaging array is designed. The FOV of this optical system is 60° × 45°; the focal lengths are 50 mm and 100 mm for the center channel and 50 mm for the other channels. This concentric multi-scale zoom system has the advantages of both high-precision imaging stitching with a wide object distance and high-resolution imaging, which makes up for the defects of the conventional concentric multi-scale optical system, making it a promising application in the fields of aviation and security.

show abstract

Development of a scalable image formation pipeline for multiscale gigapixel photography

Cited by 28 publications

References 15 publications

Adaptive Compositing and Navigation of Variable Resolution Images

Adaptive Compositing and Navigation of Variable Resolution Images

Parallel cameras

Design of a Concentric Multi-Scale Zoom Optical System Based on Wide Object Distance and High-Precision Imaging

Contact Info

Product

Resources

About