Interactive Painting and Lighting in Dynamic Multi-Projection Mapping

Lange, Vanessa; Siegl, Christian; Colaianni, Matteo; Kurth, Philipp; Stamminger, Marc; Bauer, Frank

doi:10.1007/978-3-319-40651-0_10

Cited by 7 publications

(6 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A conventional camera‐based approach that detects a shadow on the display is unsuitable for our purpose because at least one frame of delay is inevitable with that approach before the removal of the shadow after the detection. Our method is similar to a previous work that detected an occluder instead of the shadow itself [AC07, INS14, LSC*17]. Our method is different in that we can handle the limbs of a person while Audet and Cooperstock [AC07] could not.…”

Section: Related Workmentioning

confidence: 90%

“…Recently, Lange et al . [LSC*17] employed a depth camera to detect an occluder that casts a shadow. They compensated for the shadow region using a depth map transformed to each projector's point of view.…”

Section: Related Workmentioning

confidence: 99%

“…Upon detection of a shadow, the occluded region is compensated for accordingly. The second approach predicts a shadow region by observing the motion of the occluder [AC07, INS14, LSC*17]. By projecting the tracked occluder onto the display, the shadow region is estimated.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Real‐Time Human Shadow Removal in a Front Projection System

Kim

Seo

Cha

et al. 2018

Computer Graphics Forum

View full text Add to dashboard Cite

When a person is located between a display and an operating projector, a shadow is cast on the display. The shadow on the display may eliminate important visual information and therefore adversely affect the viewing experiences. There have been various attempts to remove the human shadow cast on a projection display by using multiple projectors. While previous approaches successfully removed the shadow region when a person moderately moves around or stands stationary in front of the display, there is still an afterimage effect due to the lack of consideration of the limb motion of the person. We propose a new real‐time approach to removing the shadow cast by a person who dynamically interacts with the display, making limb motions in a front projection system. The proposed method utilizes a human skeleton obtained from a depth camera to track the posture of the person which changes over time. A model that consists of spheres and conical frustums is constructed based on the skeleton information in order to represent volumetric information of the person being tracked. Our method precisely estimates the shadow region by projecting the volumetric model onto the display. In addition, employment of intensity masks that are built based on a distance field helps suppress the afterimage of the shadow that appears when the person moves abruptly. It also helps blend the projected overlapping images from different projectors and show one smoothly combined display. The experiment results verify that our approach removes the shadow of a person effectively in a front projection environment and is fast enough to achieve real‐time performance.

show abstract

Section: Related Workmentioning

confidence: 90%

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Real‐Time Human Shadow Removal in a Front Projection System

Kim

Seo

Cha

et al. 2018

Computer Graphics Forum

View full text Add to dashboard Cite

show abstract

“…A large body of literature exists on projection mapping on static objects [22,[27][28][29][30][31][32][33][35][36][37]. When considering dynamic objects, [2,3,5,7,[10][11][12][13][14][15][16][17][18] handle rigid objects with known geometry in an accurately calibrated non-real-time system. [10,13,14] use specialized high-speed coaxial projector and camera to map specialized planar objects (e.g.…”

Section: Related Workmentioning

confidence: 99%

Dynamic Projection Mapping of Deformable Stretchable Materials

Ibrahim

Gopi

Majumder³

2020

26th ACM Symposium on Virtual Reality Software and Technology

View full text Add to dashboard Cite

show abstract

“…However, due to the runtime calculations, the target object can be moved and the projected content can change dynamically. This is especially important for animations on the target objects or a live painting system such as the one in Lange et al [11].…”

Section: Performancementioning

confidence: 99%

Adaptive stray-light compensation in dynamic multi-projection mapping

et al. 2017

Self Cite

View full text Add to dashboard Cite

Projection-based mixed reality is an effective tool to create immersive visualizations on real-world objects. Its wide range of applications includes art installations, education, stage shows, and advertising. In this work, we enhance a multi-projector system for dynamic projection mapping by handling various physical stray-light effects: interreflection, projector black-level, and environmental light in real time for dynamic scenes. We show how all these effects can be efficiently simulated and accounted for at runtime, resulting in significantly improved projection mapping results. By adding a global optimization step, we can further increase the dynamic range of the projection.

show abstract

Interactive Painting and Lighting in Dynamic Multi-Projection Mapping

Cited by 7 publications

References 15 publications

Real‐Time Human Shadow Removal in a Front Projection System

Real‐Time Human Shadow Removal in a Front Projection System

Dynamic Projection Mapping of Deformable Stretchable Materials

Adaptive stray-light compensation in dynamic multi-projection mapping

Contact Info

Product

Resources

About