Cooperative Augmentation of Smart Objects with Projector-Camera Systems

Molyneaux, David; Gellersen, Hans; Kortuem, Gerd; Schiele, Bernt

doi:10.1007/978-3-540-74853-3_29

Cited by 17 publications

(16 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In these approaches, a predetermined set of cues are fused in particle filter tracking frameworks, allowing multiple target hypotheses to exist simultaneously. In contrast, we propose to determine the choice of cue at runtime, based on the idea that smart objects contain a model of their appearance [Molyneaux et al 2007], and support all of the preceding cues in our proof-of-concept system. In addition to the aforesaid cues, there has been a surge in use of depth information enabled by Kinect.…”

Section: Object Detection and Trackingmentioning

confidence: 95%

“…We recently introduced cooperative augmentation as a new systems approach to visual augmentation of mobile objects with projector-camera systems [Molyneaux et al 2007]. In conventional AR, objects are passive, whereas our point of departure is smart objects that actively cooperate with projector-camera systems in order to achieve visual augmentation.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Cooperative augmentation of mobile smart objects with projected displays

Molyneaux

Gellersen

Finney

2013

ACM Trans. Interact. Intell. Syst.

Self Cite

View full text Add to dashboard Cite

Sensors, processors, and radios can be integrated invisibly into objects to make them smart and sensitive to user interaction, but feedback is often limited to beeps, blinks, or buzzes. We propose to redress this input-output imbalance by augmentation of smart objects with projected displays, that-unlike physical displays-allow seamless integration with the natural appearance of an object. In this article, we investigate how, in a ubiquitous computing world, smart objects can acquire and control a projection. We consider that projectors and cameras are ubiquitous in the environment, and we develop a novel conception and system that enables smart objects to spontaneously associate with projector-camera systems for cooperative augmentation. Projector-camera systems are conceived as generic, supporting standard computer vision methods for different appearance cues, and smart objects provide a model of their appearance for method selection at runtime, as well as sensor observations to constrain the visual detection process. Cooperative detection results in accurate location and pose of the object, which is then tracked for visual augmentation in response to display requests by the smart object. In this article, we define the conceptual framework underlying our approach; report on computer vision experiments that give original insight into natural appearance-based detection of everyday objects; show how object sensing can be used to increase speed and robustness of visual detection; describe and evaluate a fully implemented system; and describe two smart object applications to illustrate the system's cooperative augmentation process and the embodied interactions it enables with smart objects. ACM Reference Format:Molyneaux, D., Gellersen, H., and Finney, J. 2013. Cooperative augmentation of mobile smart objects with projected displays.

show abstract

Section: Object Detection and Trackingmentioning

confidence: 95%

Section: Introductionmentioning

confidence: 99%

Cooperative augmentation of mobile smart objects with projected displays

Molyneaux

Gellersen

Finney

2013

ACM Trans. Interact. Intell. Syst.

Self Cite

View full text Add to dashboard Cite

show abstract

“…We compared the effect in two extreme cases, as can be seen in Figure 1: 1) presented close to a target of danger (CT) and 2) at a dedicated area on the closer side of an experimental table with a rectangular frame (DA). The CT presentation is popular in augmented reality (AR) systems, where information is overlaid on or near a physical object [3,5]. The result showed that the number of interpretations was significantly affected by spatial connectedness.…”

Section: Spatial Ambiguitymentioning

confidence: 96%

Nondirective information presentation for on-site safety training in chemistry experiments

Fujinami

Sokan

2012

Proceedings of the International Working Conference on Advanced Visual Interfaces

View full text Add to dashboard Cite

A chemistry experiment in a school should be conducted safely, yet provide an effective education. In this paper, we explore the impacts of a nondirective presentation on onsite safety training, particularly for experimental operations. The nondirective presentation is intended for a student's future independent operation by facilitating active thinking, which is realized by two aspects of presentation ambiguity: multiple interpretations of the content of a message and the message positioning on a table. Simulation-based experiments suggest that a message presented at a dedicated (static) area with a less semantically ambiguous message (Low semantic -High spatial ambiguities, LH) is the most appropriate combination of ambiguity levels compared to the other three combinations, LL, HL, and HH. Additionally, we examine the necessity of applying different levels relevant to the danger.

show abstract

“…Other implementations involve carrying a mobile device that can be looked through using the device's camera [22]. Yet another approach to augment the environment visually is to project images on surfaces in the environment [12,2].…”

Section: Background and Related Workmentioning

confidence: 99%

User experience and usage scenarios of audio-tactile interaction with virtual objects in a physical environment

Väänänen-Vainio-Mattila

Suhonen

Laaksonen

et al. 2013

Proceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces

View full text Add to dashboard Cite

Augmented reality (AR) systems enable new user experiences while the user is interacting with virtual objects in the physical space. The virtual objects have mostly been presented visually, overlaid on the physical world. In this paper, we present an explorative user study of a prototype system AHNE with the aim to understand the user experience and usage potential of non-visual audio-tactile augmented reality interactions. The qualitative results reveal that non-visual interaction was experienced confusing at first, but also fun, playful, and exciting. Even though audio feedback clearly dominates the spatial interaction experience, tactile feedback makes the virtual objects feel more concrete. The ideated and evaluated set of 23 usage scenarios includes both game-like and pragmatic application ideas for individual and social usage. The results can be used to inform the design of novel AR applications that utilise human senses beyond vision.

show abstract

Cooperative Augmentation of Smart Objects with Projector-Camera Systems

Cited by 17 publications

References 26 publications

Cooperative augmentation of mobile smart objects with projected displays

Cooperative augmentation of mobile smart objects with projected displays

Nondirective information presentation for on-site safety training in chemistry experiments

User experience and usage scenarios of audio-tactile interaction with virtual objects in a physical environment

Contact Info

Product

Resources

About