Shadow tracking on multi-touch tables

Echtler, Florian; Huber, Manuel; Klinker, Gudrun

doi:10.1145/1385569.1385640

Cited by 46 publications

(23 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, we believe our examples of unified interaction techniques will be implementable in the near future on much more affordable emerging technologies, e.g., shadow tracking [8], switchable diffusers [15], depth cameras [36], or any other technology that can accurately detect movement above the surface. Currently, these other technologies do not yet provide the necessary accurate tracking of 3D positions of hands, fingers, and objects above a tabletop surface.…”

Section: Infrastructure For Rapidly Prototyping Interaction Techniquesmentioning

confidence: 99%

“…For example, by sensing the position of people's hands above the surface interface, widgets on the touch screen (such as buttons, sliders) can give people visual or audible feedback about possible actions (e.g., [8]). Similar to the way GUI buttons often change their color when the mouse cursor hovers over the button, the interactive elements of our tabletop application interface could change their visual appearance (e.g., glowing border, different background color) once a person's hand approaches the widget.…”

Section: Feedback Of Possible Actions By Hoveringmentioning

confidence: 99%

“…Unlike the approach in this paper, most developed 'point systems' or techniques rather than consider the space holistically. Echtler tracked hand shadows to support hovering actions on a tabletop [8], mimicking the mouse hover action. Izadi applied a switchable diffuser to the tabletop, which captures hand gestures above the tabletop [16].…”

Section: Multi-touch Tabletop Interactionmentioning

confidence: 99%

See 2 more Smart Citations

The Continuous Interaction Space: Interaction Techniques Unifying Touch and Gesture on and above a Digital Surface

Marquardt

Jota

Greenberg

et al. 2011

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Abstract. The rising popularity of digital table surfaces has spawned considerable interest in new interaction techniques. Most interactions fall into one of two modalities: 1) direct touch and multi-touch (by hand and by tangibles) directly on the surface, and 2) hand gestures above the surface. The limitation is that these two modalities ignore the rich interaction space between them. To move beyond this limitation, we first contribute a unification of these discrete interaction modalities called the continuous interaction space. The idea is that many interaction techniques can be developed that go beyond these two modalities, where they can leverage the space between them. That is, we believe that the underlying system should treat the space on and above the surface as a continuum, where a person can use touch, gestures, and tangibles anywhere in the space and naturally move between them. Our second contribution illustrates this, where we introduce a variety of interaction categories that exploit the space between these modalities. For example, with our Extended Continuous Gestures category, a person can start an interaction with a direct touch and drag, and then naturally lift off the surface and continue their drag with a hand gesture over the surface. For each interaction category, we implement an example (or use prior work) that illustrates how that technique can be applied. In summary, our primary contribution is to broaden the design space of interaction techniques for digital surfaces, where we populate the continuous interaction space both with concepts and examples that emerge from considering this space as a continuum.

show abstract

Section: Infrastructure For Rapidly Prototyping Interaction Techniquesmentioning

confidence: 99%

Section: Feedback Of Possible Actions By Hoveringmentioning

confidence: 99%

Section: Multi-touch Tabletop Interactionmentioning

confidence: 99%

See 1 more Smart Citation

The Continuous Interaction Space: Interaction Techniques Unifying Touch and Gesture on and above a Digital Surface

Marquardt

Jota

Greenberg

et al. 2011

Lecture Notes in Computer Science

View full text Add to dashboard Cite

show abstract

“…Multi-touch surfaces have been based on a variety of technologies, e.g., [8,14,21,40], each with their own strengths and weaknesses. Touch has also been exploited in different ways, ranging from touch alone, to multi-fingers [40], to hand shape [9] and hand postures [10], and to gestures [38].…”

Section: Background and Related Workmentioning

confidence: 99%

Designing user-, hand-, and handpart-aware tabletop interactions with the TouchID toolkit

Marquardt

Kiemer

Ledo

et al. 2011

Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces

View full text Add to dashboard Cite

Recent work in multi-touch tabletop interaction introduced many novel techniques that let people manipulate digital content through touch. Yet most only detect touch blobs. This ignores richer interactions that would be possible if we could identify (1) which hand, (2) which part of the hand, (3) which side of the hand, and (4) which person is actually touching the surface. Fiduciary-tagged gloves were previously introduced as a simple but reliable technique for providing this information. The problem is that its lowlevel programming model hinders the way developers could rapidly explore new kinds of user-and handpartaware interactions. We contribute the TOUCHID toolkit to solve this problem. It allows rapid prototyping of expressive multi-touch interactions that exploit the aforementioned characteristics of touch input. TOUCHID provides an easy-to-use event-driven API. It also provides higher-level tools that facilitate development: a glove configurator to rapidly associate particular glove parts to handparts; and a posture configurator and gesture configurator for registering new hand postures and gestures for the toolkit to recognize. We illustrate TOUCHID's expressiveness by showing how we developed a suite of techniques (which we consider a secondary contribution) that exploits knowledge of which handpart is touching the surface.

show abstract

“…As the rear-mounted camera generates 60 frames per second, it is possible to alternate between the shadow tracker and the FTIR surface every other frame while still providing a smooth user experience. For a more detailed description of the hardware design and the various issues which had to be solved, see our previous paper [4].…”

Section: Hardware Setupmentioning

confidence: 99%

Supporting casual interactions between board games on public tabletop displays and mobile devices

Echtler¹,

Nestler²,

Dippon³

et al. 2009

Pers Ubiquit Comput

Self Cite

View full text Add to dashboard Cite

As more interactive surfaces enter public life, casual interactions from passersby are bound to increase. Most of these users can be expected to carry a mobile phone or PDA, which nowadays offers significant computing capabilities of its own. This offers new possibilities for interaction between these users' private displays and large public ones.In this paper, we present a system which supports such casual interactions. We first explore a method to track mobile phones that are placed on a horizontal interactive surface by examining the shadows which are cast on the surface. This approach detects the presence of a mobile device, as opposed to any other opaque object, through the signal strength emitted by the built-in Bluetooth transceiver without requiring any modifications to the devices' software or hardware.We then go on to investigate interaction between a Sudoku game running in parallel on the public display and on mobile devices carried by passing users. Mobile users can join a running game by placing their devices on a designated area. The only requirement is that the device is in discoverable Bluetooth mode. After a specific device has been recognized, a client software is sent to the device which then enables the user to interact with the running game. Finally, we explore the results of a study which we conducted to determine the effectiveness and intrusiveness of interactions between users on the tabletop and users with mobile devices.

show abstract

Shadow tracking on multi-touch tables

Cited by 46 publications

References 13 publications

The Continuous Interaction Space: Interaction Techniques Unifying Touch and Gesture on and above a Digital Surface

The Continuous Interaction Space: Interaction Techniques Unifying Touch and Gesture on and above a Digital Surface

Designing user-, hand-, and handpart-aware tabletop interactions with the TouchID toolkit

Supporting casual interactions between board games on public tabletop displays and mobile devices

Contact Info

Product

Resources

About