Low-bandwidth 3D visual telepresence system

Córdova-Esparza, Diana-Margarita; Terven, Juan R.; Hernandez, H.; Herrera-Navarro, Ana M.; Vázquez-Cervantes, Alberto; García-Huerta, Juan-M.

doi:10.1007/s11042-019-7464-0

Cited by 11 publications

(4 citation statements)

References 30 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For performance assessment, [6,16,51,55,57,70,74,77,90] measured frame rates of application and network latency by [6,17,91]. [58,78] monitor the refresh rates of the 3D reconstruction method and the latency of the overall system [15,42,51,70,75,76,78,92,93]. [79] measure the processing time for encoding silhouette images.…”

Section: Evaluation Of 3d Reconstruction Methods For Telepresence Systemmentioning

confidence: 99%

A systematic literature review: Real-time 3D reconstruction method for telepresence system

Fadzli,

Ismail,

Abd Karim Ishigaki

2023

PLoS ONE

View full text Add to dashboard Cite

Real-time three-dimensional (3D) reconstruction of real-world environments has many significant applications in various fields, including telepresence technology. When depth sensors, such as those from Microsoft’s Kinect series, are introduced simultaneously and become widely available, a new generation of telepresence systems can be developed by combining a real-time 3D reconstruction method with these new technologies. This combination enables users to engage with a remote person while remaining in their local area, as well as control remote devices while viewing their 3D virtual representation. There are numerous applications in which having a telepresence experience could be beneficial, including remote collaboration and entertainment, as well as education, advertising, and rehabilitation. The purpose of this systematic literature review is to analyze the recent advances in 3D reconstruction methods for telepresence systems and the significant related work in this field. Next, we determine the input data and the technological device employed to acquire the input data, which will be utilized in the 3D reconstruction process. The methods of 3D reconstruction implemented in the telepresence system as well as the evaluation of the system, have been extracted and assessed from the included studies. Through the analysis and summarization of many dimensions, we discussed the input data used for the 3D reconstruction method, the real-time 3D reconstruction methods implemented in the telepresence system, and how to evaluate the system. We conclude that real-time 3D reconstruction methods for telepresence systems have progressively improved over the years in conjunction with the advancement of machines and devices such as Red Green Blue-Depth (RGB-D) cameras and Graphics Processing Unit (GPU).

show abstract

Section: Evaluation Of 3d Reconstruction Methods For Telepresence Systemmentioning

confidence: 99%

A systematic literature review: Real-time 3D reconstruction method for telepresence system

Fadzli,

Ismail,

Abd Karim Ishigaki

2023

PLoS ONE

View full text Add to dashboard Cite

show abstract

“…The light-field display system of the telepresence [22] True holographic displays and specialized technology are expensive to produce, and several attempts have been made to develop simulated holographic displays for these reasons [23], which have proven unsuccessful. The remote participant's 3D model afloat on an inverted pyramid is projected to imitate a holographic projection [24], and [25] gives a true life-sized holographic view of the professor, which allows for more efficient connection and impact on the viewers, who are the students.…”

Section: Holographic Projectionmentioning

confidence: 99%

3D Display for 3D Telepresence: A Review

2021

View full text Add to dashboard Cite

Over the years, people have tried to advance 3D display technology and researchers as well as developers have created different innovations in recent decades. there are many other different types of 3D display technology that can be classified into stereoscopic, auto stereoscopic, holographic and volumetric 3D displays. This paper, however, discusses the 3D display technology that have been implemented in the telepresence system, which can be divided into two main devices, projectors and head mounted display (HMD). From these two devices, the 3D display technology using projector devices are on-stage hologram, auto stereoscopic display, and holographic projection; while for HMD can be divided into MR headset and VR HMD. This paper provides a review on these 3D display for telepresence. Finally, we make a comparison based on the features of the 3D display technologies such as life-size capability, viewable from different perspectives, headset-free experience number of viewers per device, level of ease of setup and the nausea of discomfort level. To choose the best 3D display technology for a telepresence system, we must first identify the number of users who will be projected and who will be viewed. The goal and activity of using telepresence technology will also define the appropriate type of 3D display.

show abstract

“…The RGB cameras capture high definition data to be used for the reconstructed frame which represented as a polygonal mesh with polygons textured. [20] introduced a telepresence system based on simulated holographic with the aim to discard the need for HMD by using holographic display composed of commodity light projector and an acrylic square pyramid. They proceeded their work to create a visual telepresence system that is low-bandwidth and cost-effective using commodity depth sensors [21].…”

Section: Previous Workmentioning

confidence: 99%

“…[20] introduced a telepresence system based on simulated holographic with the aim to discard the need for HMD by using holographic display composed of commodity light projector and an acrylic square pyramid. They proceeded their work to create a visual telepresence system that is low-bandwidth and cost-effective using commodity depth sensors [21]. Remote collaboration using telepresence system which combined 360 video and 3D reconstruction together has been proposed by [22].…”

Section: Previous Workmentioning

confidence: 99%

A Robust Real-Time 3D Reconstruction Method for Mixed Reality Telepresence

Fadzli

Ismail

2020

Int J Innov Comp

View full text Add to dashboard Cite

Mixed Reality (MR) is a technology which enable to bring a virtual element into the real-world environment. MR intends to improve reality on the virtual world immerse onto real-world space. Occasionally the MR has been improved as the display technologies advanced progressively. In MR collaborative interface context, the local and remote user work together on collaborative task while sense the immersive environment in the cooperative application. User telepresence is an immersive telepresence, where the reconstruction of a human appears in a real-life. Up till now, producing full telepresence of the life-size human body may require a high transmission bandwidth of the internet. Therefore, this paper explores on a robust real-time 3D reconstruction method for MR telepresence. This paper discusses the previous works on the reconstruction method of a full-body human and the existing research works that have proposed the reconstruction methods for telepresence. Besides the 3D reconstruction method, this paper also enlightens our recent finding on the MR framework to transport a full-body human from a local location to a remote location. The MR telepresence will be discussed, as well as the robust 3D reconstruction method which has been implemented with user telepresence feature where the user experiences an accurate 3D representation of a remote person. The paper ends with the discussion and results, MR telepresence with robust 3D reconstruction method to execute user telepresence.

show abstract

Low-bandwidth 3D visual telepresence system

Cited by 11 publications

References 30 publications

A systematic literature review: Real-time 3D reconstruction method for telepresence system

A systematic literature review: Real-time 3D reconstruction method for telepresence system

3D Display for 3D Telepresence: A Review

A Robust Real-Time 3D Reconstruction Method for Mixed Reality Telepresence

Contact Info

Product

Resources

About