Multi-face real-time tracking based on dual panoramic camera for full-parallax light-field display

Tian, Mingzhe; Ni, Lixia; Liang, Xu; Li, Haifeng; Liu, Xü

doi:10.1016/j.optcom.2019.02.025

Cited by 6 publications

(4 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The camera was attached to an adjustable panoramic head of the Nodal Ninja Ultimate M2 type, which includes rotating elements with gradations, which helps to optimally position the camera for capturing photos. At the same time, the panoramic head helps to reduce the parallax that most panoramic images acquired at cultural heritage elements suffer from [54][55][56]. To reduce the unwanted influence of parallax, in addition to using the panoramic head, the internal characteristics of the device were calibrated in the laboratory, and the external characteristics (mounting mode on the panoramic head) were adjusted on the spot using between 2 and 3 dedicated tripods.…”

Section: Creation Of Three-dimensional Models Of the Interior Of Darv...mentioning

confidence: 99%

Digitization of the Built Cultural Heritage: An Integrated Methodology for Preservation and Accessibilization of an Art Nouveau Museum

Caciora,

Jubran,

Ilies

et al. 2023

Remote Sensing

View full text Add to dashboard Cite

The emergence of new technologies has dynamized the way in which cultural heritage is documented, preserved, and passed on to new generations; something that determines a paradigm shift in terms of research in this field. Most operations now also have access to the virtual component. In this context, the current study aimed to make accessible through virtual and augmented reality one of the most interesting objectives belonging to the Jewish cultural heritage built in Art Nouveau style in the municipality of Oradea (Romania), which currently functions as a La Belle Epoque Museum. In the study, the techniques of terrestrial, aerial photogrammetry, and terrestrial laser scanning were used to remodel, in a three-dimensional format, as faithful as possible and usable in different applications, the special architecture of the exterior of the monument. This information was doubled by making the interior of the monument accessible through a complete and complex series of panoramic images interconnected within a virtual tour that will be made available to tourists interested in discovering the Darvas-La Roche House. The virtual tour, which includes both graphic, textual, and audio information, represents an innovative approach for the buildings built in Art Nouveau style in the municipality of Oradea, representing a virtual bridge for better promotion of the tourist destination and for the awareness of the local people regarding the importance of preserving and appreciating the local cultural heritage. This is all the more important as this is the first initiative to make the Art Nouveau buildings in Oradea Municipality accessible to the general public in an innovative way.

show abstract

Section: Creation Of Three-dimensional Models Of the Interior Of Darv...mentioning

confidence: 99%

Digitization of the Built Cultural Heritage: An Integrated Methodology for Preservation and Accessibilization of an Art Nouveau Museum

Caciora,

Jubran,

Ilies

et al. 2023

Remote Sensing

View full text Add to dashboard Cite

show abstract

“…The light field is mainly reconstructed in the way of time-division multiplexing. Based on this hardware structure, recently, we have proposed a 360° face tracking system by using of a dual-panoramic camera for full-parallax light-field display [9]. We have studied a multiface real-time tracking algorithm and realized the real-time generation of vertical parallax for multi-viewers and finally finish the light field rendering software.…”

Section: Projection Light Field Tabletop 3d Displaymentioning

confidence: 99%

33‐1:Invited Paper:Tabletop True 3D Display Systems based on Projection Light Field and Integral Imaging

Wang

Xia

et al. 2020

Symp Digest of Tech Papers

View full text Add to dashboard Cite

In this paper, we introduce two tabletop true 3D display systems based on the projection light field and integral imaging. In the projection light field tabletop system, a dual-panoramic camera is used for multi-face real time tracking and achieving full parallax, and gesture-based interaction by Leap Motion is also added for free and accurate interaction. In the integral imaging system, an optimized compound lens array is designed to improve the viewing angle of the 3D image, and the liquid light diffuser is proposed to increase the depth of field of the 3D image.

show abstract

“…Thus, a scanning mechanism or a tiling configuration is needed to expand the viewing angle 7,8 . With multi‐projectors or a high‐speed projector, 9,10 project‐based light field displays can realize horizontal parallax with a viewing angle of 360°, while vertical parallax is comparatively challenging to achieve without tracking. Vector light field displays are a newborn technique based on precise light manipulation of each pixel with nanostructures 11 .…”

Section: Introductionmentioning

confidence: 99%

Performance improvement for additive light field displays with weighted simultaneous algebra reconstruction technique and tracked views

Gao

Dong

et al. 2023

J Soc Info Display

Self Cite

View full text Add to dashboard Cite

Additive light field displays are transparent autostereoscopic three‐dimensional displays without backlights, thus suitable for augmented reality applications. However, when the parallax between viewpoint images becomes large with the increase of viewing angle, the optimization algorithm is hard to handle too many dissimilarities evenly on all viewpoints, resulting in poor reconstructed quality. This paper presents an additive light field display using the weighted simultaneous algebraic reconstruction technique with viewing angle‐dependent weight distribution functions. We constrain the optimization to deliver a reconstructed light field of high image quality for viewpoints of large weight. When the proposed method is applied, with a wide dynamic viewing angle of 57° × 43°, the tracked views' peak signal‐to‐noise ratio exceeds 30 dB with only two additive display layers.

show abstract

Multi-face real-time tracking based on dual panoramic camera for full-parallax light-field display

Cited by 6 publications

References 18 publications

Digitization of the Built Cultural Heritage: An Integrated Methodology for Preservation and Accessibilization of an Art Nouveau Museum

Digitization of the Built Cultural Heritage: An Integrated Methodology for Preservation and Accessibilization of an Art Nouveau Museum

33‐1:Invited Paper:Tabletop True 3D Display Systems based on Projection Light Field and Integral Imaging

Performance improvement for additive light field displays with weighted simultaneous algebra reconstruction technique and tracked views

Contact Info

Product

Resources

About