Illuminating clay

Piper, Ben; Ratti, Carlo; Ishii, Hiroshi

doi:10.1145/503376.503439

Cited by 258 publications

(17 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Real sand or similar material as interaction material has been used in several applications and installations. In 2002, Piper, Ratti, and Ishii presented their Illuminating Clay system for the analysis of landscapes in the landscape design process [22]. Their system consists of a clay model that users manipulate, a laser scanner for capturing of depth information, and a projector that closes the feedback loop for visualization of different landscape analysis functions.…”

Section: Related Workmentioning

confidence: 99%

“…In the literature, there is a considerable body of research that has explored augmented sandboxes and its tangible affordances (e.g., [26,24,2,8,25]). In many application scenarios, sandboxes have been applied to offer a better understanding of spatial and geographical phenomena [13,22], or to experience the terrain playfully [25,8,2]. Most setups use a projector mounted above the sandbox, projecting an image on the surface of the sand and a depth camera for tracking the sand's shape.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

VRBox

Fröhlich

Alexandrovsky

Stabbert

et al. 2018

Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play

View full text Add to dashboard Cite

Augmented sandboxes have been used as playful and educative tools to create, explore and understand complex models. However, current solutions lack interactive capabilities, missing more immersive experiences such as exploring the sand landscape from a first person perspective. We extend the interaction space of augmented sandboxes into virtual reality (VR) to offer a VR-environment that contains a landscape, which the user designs via interacting with real sand while wearing a virtual reality head-mounted display (HMD). In this paper, we present our current VR-sandbox system consisting of a box with sand, triple Kinect depth sensing, a virtual reality HMD, and hand tracking, as well as an interactive world simulation use case for exploration and evaluation. Our work explores the important and timely topics how to integrate rich haptic interaction with natural materials into VR and how to track and present real physical materials in VR. In a qualitative evaluation with nine experts from computer graphics, game design, and didactics we identified potentials, limitations as well as future application scenarios.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

VRBox

Fröhlich

Alexandrovsky

Stabbert

et al. 2018

Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play

View full text Add to dashboard Cite

show abstract

“…As an alternative, 3D scanners can be used as input devices. For example, the SandScape project [40] allows the user to model a relief in sand, which is scanned in short intervals, interpreted as terrain, and simulation data is then projected onto the sand. However, the input here was more the changing sand surface than the user's hand.…”

Section: Related Workmentioning

confidence: 99%

Pictures in Your Mind

Reichinger

Carrizosa

Wood

et al. 2018

ACM Trans. Access. Comput.

View full text Add to dashboard Cite

Tactile reliefs offer many benefits over the more classic raised line drawings or tactile diagrams, as depth, 3D shape, and surface textures are directly perceivable. Although often created for blind and visually impaired (BVI) people, a wider range of people may benefit from such multimodal material. However, some reliefs are still difficult to understand without proper guidance or accompanying verbal descriptions, hindering autonomous exploration. In this work, we present a gesture-controlled interactive audio guide (IAG) based on recent low-cost depth cameras that can be operated directly with the hands on relief surfaces during tactile exploration. The interactively explorable, location-dependent verbal and captioned descriptions promise rapid tactile accessibility to 2.5D spatial information in a home or education setting, to online resources, or as a kiosk installation at public places. We present a working prototype, discuss design decisions, and present the results of two evaluation studies: the first with 13 BVI test users and the second follow-up study with 14 test users across a wide range of people with differences and difficulties associated with perception, memory, cognition, and communication. The participant-led research method of this latter study prompted new, significant and innovative developments. CCS Concepts: • Human-centered computing → User studies; Gestural input; Accessibility systems and tools; Auditory feedback; • Applied computing → Fine arts;

show abstract

“…Furthermore, spatial AR is used for novel interactions (e. g. MirageTable [6]) or increased immersion (e. g. RoomAlive [24]). With Illuminating Clay, Piper et al [30] augmented a manually deformable surface with volume data through projection mapping.…”

Section: Spatial Augmented Realitymentioning

confidence: 99%

Combining Shape-Changing Interfaces and Spatial Augmented Reality Enables Extended Object Appearance

Lindlbauer

Grønbæk

Birk

et al. 2016

Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

Figure 1. We combine shape-changing interfaces with spatial augmented reality. Shape-changing interfaces physically render coarse shapes and slow movements. Spatial augmented reality is used to display arbitrary textures, objects, and fast motion, directly onto the shape-changing device. This allows us to take advantage of natural depth cues and occlusion. We demonstrate the combination of the two techniques in three applications, i. e. a weather app with waves rendered physically and virtually (left) and a game with position of important game elements emphasized through shape change (center). We show capabilities of enriching shape-changing interfaces with spatial AR, e. g. the ability to render arbitrary objects and shadows (right).

show abstract

Illuminating clay

Cited by 258 publications

References 9 publications

VRBox

VRBox

Pictures in Your Mind

Combining Shape-Changing Interfaces and Spatial Augmented Reality Enables Extended Object Appearance

Contact Info

Product

Resources

About