An Architecture and Framework for Steerable Interface Systems

Abstract

Abstract. Steerable Interfaces are emerging as a new paradigm used in realizing the vision of embodied interaction in ubiquitous computing environments. Such interfaces steer relevant input and output capabilities around space, to serve the user when and where they are needed. We present an architecture and a programming framework that enable the development of Steerable Interface applications. The distributed multi-layer architecture provides applications with abstractions to services of several novel components -for instance, steerable projection, steerable visual interaction detection, and geometric reasoning. The programming framework facilitates integration of the various services while hiding the complexity of sequencing and synchronizing the underlying components.

Cooperative augmentation of mobile smart objects with projected displays

“…In contrast, our work expands out from closed worlds in which systems know their objects, and aims to tackle spontaneous visual augmentation of objects, in principle in any environment that has projector-camera equipment. In terms of architecture for projector-camera systems, the steerable interface system [Levas et al 2003] provides a framework that is similar to ours but limited to display in static locations that are precalibrated by the user. Since our own system development, Microsoft's Kinect has emerged as a technology that enables depth imaging at low cost.…”

“…Table II provides an overview of the phases, detailing the interactions involved between smart object and projector-camera system. Registration follows a standard model of dynamic service discovery and association, and the projection and interaction phases are based on mechanisms that in essence have been demonstrated by other projection frameworks, such as the steerable interface system [Levas et al 2003]. However, detection and model update involve an entirely new approach, in which smart objects and projector-camera system cooperate to acquire, exchange, use, and update knowledge about the object's appearance.…”

Cooperative Augmentation of Smart Objects with Projector-Camera Systems

“…Levas et al first presented a framework for steerable projector-camera systems to project onto objects and surfaces in their Everywhere Display framework [8]. However, although supporting a distributed architecture, this framework was limited to creating displays on static surfaces in locations pre-calibrated by the user.…”

Using Symbiotic Displays to View Sensitive Information in Public

“…In response to user input indicating intent to read the incoming message, the watch displays the list of surfaces to the user, adding the local watch screen as one of the options. The user can scroll through the list using the stem switch and the watch sends each wheel click to the proxy which communicates with the ED-controller program using an XML command language called EDML [8]. When the user presses the stem switch to select a display, the proxy automatically sets the privacy threshold to the highest level, and sends the appropriately filtered message to the display.…”

“…More importantly the task of adding intelligence to the EDprojector system is aided by the fact that it already has a good deal of intelligence and is configurable to different surfaces and display layouts using commands specified in an XML format [8]. Figure 5.…”