Virtual Mirror: Real-Time Tracking of Shoes in Augmented Reality Environments

Abstract

In this paper, we present a system that enhances the visualization of customized sports shoes using augmented reality techniques. Instead of viewing yourself in a real mirror, sophisticated 3D image processing techniques are used to verify the appearance of new shoe models. A single camera captures the person and outputs the mirrored images onto a large display which replaces the real mirror. The 3D motion of both feet are tracked in real-time with a new motion tracking algorithm. Computer graphics models of the shoes are augmented into the video such that the person seems to wear the virtual shoes.

Through the combining glass

“…This idea of augmenting reflections with non-real (virtual) elements has been explored in practice. Approaches like i-Mirror [12], augmented mirror box [26] or the virtual mirrors by Adidas [9] and Bloomingdale's 5 use video seethrough AR (see Figure 2.A), recording the user and adding virtual elements to the digital image. These approaches lose the affordances of real mirrors, replacing volumetric reflections with digitized 2D images of the users, having a fixed perspective (i.e.…”

“…Augmented mirrors [1,9,11,21,27] use reflections as high fidelity avatars that can be augmented with virtual clothes or visual effects. Situated AR [13,14,24] exploits planar reflections by overlapping 3D virtual objects with the physical space and enabling direct interaction with those objects.…”

RE-LIVING LAS VEGAS: A multi-user, mixed-reality edutainment environment based on the enhancement of original archival materials

“…Each visitor, one by one, has to go into the dressing room where he will find a virtual mirror ( [13]) displaying on screen the images of the user wearing virtual clothes from the Golden Music Age, which visitor can choose from a catalogue of vintage clothes. This picture (visitor and clothes) will be the avatar of the user for all the game and it will be recorded as well in the visitor's chip.…”

Virtual Experiences for Social Perspective-Taking

“…During the patient interaction, the student is recorded in front of a green screen, which is transformed into a dynamic virtual mirror during the VSP experience. Green screen mirrors have been used to add customized garments to a user's reflection [5]. Here the green screen allows the student to see his avatar while sitting up.…”