ZeroN

Abstract

This paper presents ZeroN, a new tangible interface element that can be levitated and moved freely by computer in a three dimensional space. ZeroN serves as a tangible representation of a 3D coordinate of the virtual world through which users can see, feel, and control computation. To accomplish this we developed a magnetic control system that can levitate and actuate a permanent magnet in a predefined 3D volume. This is combined with an optical tracking and display system that projects images on the levitating object. We present applications that explore this new interaction modality. Users are invited to place or move the ZeroN object just as they can place objects on surfaces. For example, users can place the sun above physical objects to cast digital shadows, or place a planet that will start revolving based on simulated physical conditions. We describe the technology, interaction scenarios and challenges, discuss initial observations, and outline future development.

Point-and-Shake

“…This vision has inspired the development of approaches for levitating objects and manipulating them in mid-air. ZeroN [13] used magnetic levitation to levitate a single large sphere. While limited to one 'atom', ZeroN supported rich visual output by projecting onto the surface of the sphere.…”

“…Interaction with the systems discussed has been limited to moving a single levitating object, either by grasping it [13,23] or mapping it to hand position [15,17]. 'Hands on' grasping interactions are not possible with acoustic levitation and are also unsuitable for levitations with several mid-air objects (e.g., the many data points in Floating Charts [18]), because the levitated objects may be too small to grasp and position correctly, they may be out of reach, or they may be inaccessible behind other objects in the physicalisation.…”

“…Two ways of doing this are to manipulate an object's position or appearance. ZeroN [13] used projectors to augment objects and JOLED [20] rotated the objects, which were coloured differently on each side. Instead, we take the first approach: manipulating the object position.…”

“…Research into the technical challenges of levitation has led to novel methods involving magnets [13], airflow [1,23] and acoustics [14,15,17], moving us closer to applications like those described earlier. Acoustic levitation, in particular, has benefited from recent work [14,15,17,20] and many objects can now be levitated and moved independently.…”

Levitating Particle Displays with Interactive Voxels

“…Several technologies have been developed to allow objects to be levitated and manipulated in mid-air, with particles ranging from small polystyrene beads [21] to large spherical magnets [12] to drones [8]. Such displays create new opportunities for interaction: users can see content from many angles and can look through the display; they can 'reach in' and interact in the empty spaces around and between particles; the physical properties of the particles and their effects on their surroundings can be meaningful in the interaction; and users can leverage their understanding of the physical world to better understand the content they are interacting with.…”