Poster: Creating a user-specific perspective view for mobile mixed reality systems on smartphones

Matsuda, Yuki; Shibata, Fumihisa; Kimura, Asako; Tokuda, Hideyuki

doi:10.1109/3dui.2013.6550226

Cited by 9 publications

(8 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…User studies conducted using simulated [Baričević et al 2012] or spatially constrained [Čopič Pucihar et al 2013;Čopič Pucihar et al 2014] systems have shown that user-perspective views have benefits over device-perspective views. Several systems have attempted to create a user-perspective view by warping the video of a video-see-through magic lens [Hill et al 2011;Matsuda et al 2013;Tomioka et al 2013]; however these approaches can only approximate the true user-perspective view as they are unable to change the point of view and therefore do not achieve the geometrically correct view frustum.…”

Section: Related Workmentioning

confidence: 99%

User-perspective augmented reality magic lens from gradients

Baričević

Höllerer

Sen

et al. 2014

Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology

View full text Add to dashboard Cite

In this paper we present a new approach to creating a geometricallycorrect user-perspective magic lens and a prototype device implementing the approach. Our prototype uses just standard color cameras, with no active depth sensing. We achieve this by pairing a recent gradient domain image-based rendering method with a novel semi-dense stereo matching algorithm inspired by PatchMatch. Our stereo algorithm is simple but fast and accurate within its search area. The resulting system is a real-time magic lens that displays the correct user perspective with a high-quality rendering, despite the lack of a dense disparity map.

show abstract

Section: Related Workmentioning

confidence: 99%

User-perspective augmented reality magic lens from gradients

Baričević

Höllerer

Sen

et al. 2014

Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology

View full text Add to dashboard Cite

show abstract

“…User studies conducted using simulated [16] or spatially constrained [17], [18] systems have shown that user-perspective views have benefits over device-perspective views. Several systems have attempted to create a user-perspective view by warping the video of a video-see-through magic lens [19], [20], [21]; however these approaches can only approximate the true user-perspective view as they are unable to change the point of view and therefore do not achieve the geometrically correct view frustum.…”

Section: Related Workmentioning

confidence: 99%

User-Perspective AR Magic Lens from Gradient-Based IBR and Semi-Dense Stereo

Baričević

Höllerer

Sen

et al. 2017

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

We present a new approach to rendering a geometrically-correct user-perspective view for a magic lens interface, based on leveraging the gradients in the real world scene. Our approach couples a recent gradient-domain image-based rendering method with a novel semi-dense stereo matching algorithm. Our stereo algorithm borrows ideas from PatchMatch, and adapts them to semi-dense stereo. This approach is implemented in a prototype device build from off-the-shelf hardware, with no active depth sensing. Despite the limited depth data, we achieve high-quality rendering for the user-perspective magic lens.

show abstract

“…Recently, several simplified variations of user-perspective rendering have emerged on handheld devices [9,13,19]. Hill et al [13] and Matsuda et al [19] implemented userperspective rendering by trimming the back-facing camera's video stream based on the viewer's POV defined by using the front-facing camera.…”

Section: User-perspective Rendering Prototypesmentioning

confidence: 99%

“…Hill et al [13] and Matsuda et al [19] implemented userperspective rendering by trimming the back-facing camera's video stream based on the viewer's POV defined by using the front-facing camera. This allowed correct alignment to the viewer's POV at a single distance, a consequence of using camera-captured images taken from device's POV, creating imagery with different perspective distortion to those seen by the observer.…”

Section: User-perspective Rendering Prototypesmentioning

confidence: 99%

The use of surrounding visual context in handheld AR

Pucihar

Coulton

Alexander

2014

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

The magic lens paradigm, a commonly used descriptor for handheld Augmented Reality (AR), presents the user with dual views: the augmented view (magic lens) that appears on the device, and the real view of the surroundings (what the user can see around the perimeter of the device). The augmented view is typically implemented by rendering the video captured by the rear-facing camera directly onto the device's screen. This results in dual perspectives-the real world being captured from the device's perspective rather than the user's perspective (what an observer would see looking through a transparent glass pane). These differences manifest themselves in misaligned and/or incorrectly scaled transparency resulting in the dual-view problem. This paper presents two user studies comparing (a) deviceperspective and (b) fixed Point-of-View (POV) userperspective magic lenses to analyze the effect of the dualview problem on the use of the surrounding visual context. The results confirm that the dual-view problem, a result of dual perspective, has a significant effect on the use of information from the surrounding visual context. The study also highlights that magnification and not the dual-view problem is the key factor explaining the correlation between magic lens size and the increased intensity of the magic lens type effect. From the results, we derive design guidelines for future magic lenses.

show abstract

Poster: Creating a user-specific perspective view for mobile mixed reality systems on smartphones

Cited by 9 publications

References 2 publications

User-perspective augmented reality magic lens from gradients

User-perspective augmented reality magic lens from gradients

User-Perspective AR Magic Lens from Gradient-Based IBR and Semi-Dense Stereo

The use of surrounding visual context in handheld AR

Contact Info

Product

Resources

About