Panoramic endoscope based on convex parabolic mirrors

Tseng, Shu-Ming; Yu, Jiancheng; Hsu, Yueh-Teng; Huang, Ching-Wen; Tsai, Yuh-Feng; Cheng, Wei‐Chung

doi:10.1117/1.oe.57.3.033102

Cited by 6 publications

(3 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The use of convex mirrors and fisheye cameras can form a panoramic stereo imaging system and can adapt to non-single-view imaging conditions for 3D reconstruction in Euclidean space [80]. The concept of the catadioptric mirror can also be applied to endoscope design to simplify and reduce the volume of the system [81], [82]. The catadioptric panorama makes it possible that endoscope capsule can also use a conic mirror to observe the inner wall of the human body [83].…”

Section: Catadioptric Panoramic Systemmentioning

confidence: 99%

Review on Panoramic Imaging and Its Applications in Scene Understanding

Gao¹,

Yang²,

Sheng³

et al. 2022

Preprint

View full text Add to dashboard Cite

With the rapid development of high-speed communication and artificial intelligence technologies, human perception of real-world scenes is no longer limited to the use of small Field of View (FoV) and low-dimensional scene detection devices. Panoramic imaging emerges as the next generation of innovative intelligent instruments for environmental perception and measurement. However, while satisfying the need for large-FoV photographic imaging, panoramic imaging instruments are expected to have high resolution, no blind area, miniaturization, and multi-dimensional intelligent perception, and can be combined with artificial intelligence methods towards the next generation of intelligent instruments, enabling deeper understanding and more holistic perception of 360 • real-world surrounding environments. Fortunately, recent advances in freeform surfaces, thinplate optics, and metasurfaces provide innovative approaches to address human perception of the environment, offering promising ideas beyond conventional optical imaging. In this review, we begin with introducing the basic principles of panoramic imaging systems, and then describe the architectures, features, and functions of various panoramic imaging systems. Afterwards, we discuss in detail the broad application prospects and great design potential of freeform surfaces, thin-plate optics, and metasurfaces in panoramic imaging. We then provide a detailed analysis on how these techniques can help enhance the performance of panoramic imaging systems. We further offer a detailed analysis of applications of panoramic imaging in scene understanding for autonomous driving and robotics, spanning panoramic semantic image segmentation, panoramic depth estimation, panoramic visual localization, and so on. Finally, we cast a perspective on future potential and research directions for panoramic imaging instruments.

show abstract

Section: Catadioptric Panoramic Systemmentioning

confidence: 99%

Review on Panoramic Imaging and Its Applications in Scene Understanding

Gao¹,

Yang²,

Sheng³

et al. 2022

Preprint

View full text Add to dashboard Cite

show abstract

“…Panoramic stereo imaging system can provide close to real stereo visual effect without complex three-dimensional modeling, which is more convenient and efficient. The existing panoramic stereo imaging technology includes curved mirror [ 3 ], fish eye lens [ 4 ] and bionic compound-eye [ 5 ]. The curved mirror and fisheye lens have the defects of large distortion and low resolution, which limit their application.…”

Section: Introductionmentioning

confidence: 99%

Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision

Wang

Zhang

2021

Sensors

View full text Add to dashboard Cite

With the rapid development of the virtual reality industry, one of the bottlenecks is the scarcity of video resources. How to capture high-definition panoramic video with depth information and real-time stereo display has become a key technical problem to be solved. In this paper, the optical optimization design scheme of panoramic imaging based on binocular stereo vision is proposed. Combined with the real-time processing algorithm of multi detector mosaic panoramic stereo imaging image, a panoramic stereo real-time imaging system is developed. Firstly, the optical optimization design scheme of panoramic imaging based on binocular stereo vision is proposed, and the space coordinate calibration platform of ultra-high precision panoramic camera based on theodolite angle compensation function is constructed. The projection matrix of adjacent cameras is obtained by solving the imaging principle of binocular stereo vision. Then, a real-time registration algorithm of multi-detector mosaic image and Lucas-Kanade optical flow method based on image segmentation are proposed to realize stereo matching and depth information estimation of panoramic imaging, and the estimation results are analyzed effectively. Experimental results show that the stereo matching time of panoramic imaging is 30 ms, the registration accuracy is 0.1 pixel, the edge information of depth map is clearer, and it can meet the imaging requirements of different lighting conditions.

show abstract

“…In another study, Roulet et al [2] proposed the design of a 360°endoscopy that would employ panomorph lens to produce wide-view images. Recently, a panoramic endoscope that used convex parabolic mirrors was developed by Tseng and Yu [3]. ese studies are important in increasing the viewing angle of the surgical images as well as the entire working area.…”

Section: Introductionmentioning

confidence: 99%

Performance Improvement for Two-Lens Panoramic Endoscopic System during Minimally Invasive Surgery

Kim

Cheng

Liu

et al. 2019

Journal of Healthcare Engineering

View full text Add to dashboard Cite

One of the major challenges for Minimally Invasive Surgery (MIS) is the limited field of vision (FOV) of the endoscope. A previous study by the authors designed a MIS Panoramic Endoscope (MISPE) that gives the physician a broad field of view, but this approach is still limited, in terms of performance and quality because it encounters difficulty when there is smoke, specular reflections, or a change in viewpoint. This study proposes a novel algorithm that increases the MISPE’s performance. The method calculates the disparity for the region that is overlapped by the two cameras to allow image stitching. An improved evaluation of the homography matrix uses a frame-by-frame calculation, so the stitched videos are more stable for MIS. The experimental results show that the revised MISPE has a FOV that is 55% greater, and the system operates stably in real time. The proposed system allows a frame rate of 26.7 fps on a single CPU computer. The proposed stitching method is 1.55 times faster than the previous method. The stitched image that is obtained using the proposed method is as similar as the ground truth as the SURF-based stitching method that was used in the previous study.

show abstract

Panoramic endoscope based on convex parabolic mirrors

Cited by 6 publications

References 9 publications

Review on Panoramic Imaging and Its Applications in Scene Understanding

Review on Panoramic Imaging and Its Applications in Scene Understanding

Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision

Performance Improvement for Two-Lens Panoramic Endoscopic System during Minimally Invasive Surgery

Contact Info

Product

Resources

About