Flexpad

Abstract

Flexpad is an interactive system that combines a depth camera and a projector to transform sheets of plain paper or foam into flexible, highly deformable, and spatially aware handheld displays. We present a novel approach for tracking deformed surfaces from depth images in real time. It captures deformations in high detail, is very robust to occlusions created by the user's hands and fingers, and does not require any kind of markers or visible texture. As a result, the display is considerably more deformable than in previous work on flexible handheld displays, enabling novel applications that leverage the high expressiveness of detailed deformation. We illustrate these unique capabilities through three application examples: curved cross-cuts in volumetric images, deforming virtual paper characters, and slicing through time in videos. Results from two user studies show that our system is capable of detecting complex deformations and that users are able to perform them quickly and precisely.

Hybrid Touch/Tangible Spatial 3D Data Selection

“…In VR, some approaches [HG02, HGR03] combined isotonic and isometric 6-DOF input to rotate and translate 3D scenes with a pen-based tablet, to facilitate 2D selections. More related to 3D visualization, Steimle et al [SJM13] investigated the use of 6 DOF spatially-aware tangible deformable surfaces to visualize slices of 3D volume/2D+time datasets. The use of touch/pen-based and 3D pen-based input with such surfaces also have been investigated for 3D visualization and interactions [ Their techniques take advantage of both input modalities to improve fluid dynamic researchers' workflow.…”

Morphees+

“…These words convey a change in shape, which means that there is an initial shape A and a final shape B. The transformation from A to B is called the deformation and can be initiated manually by the users (via molding [10], bending [12,50], twisting [47], etc.) or automatically by the system.…”

“…Users change the size of the display by folding the map or turn off the display by completely folding the umbrella. Similarly, a sheet of paper [50], a piece of fabric [51], a book [21], an ancient scroll [22], a Rubik's Magic puzzle [41] and a Rubik's cube [47] were used to design deformable displays.…”

“…inspired the design and taxonomy of reconfigurable devices (e.g., [21,22,27,28,41,47,50,51]). Reconfigurable daily objects allow us not only to inform the taxonomy features that end users are used to, but also can inspire new reconfigurable interfaces.…”

Effects of Bend Gesture Training on Learnability and Memorability in a Mobile Game

“…Overview ................................................................................................................................ 1 1.2 Contributions .................................................................................................................. .......................................................................................................................... ............................................................................ 53 5 Conclusion ...................................................................................................................... 55 5.1 Limitations .......................................................................................................................... 55 5.2 Future Work .......................................................................................................................... 57 Appendices ... .......................................................................................................................... 59 Appendix A ........................................................................................................................................ 59 Appendix B ........................................................................................................................................ 63 Appendix C ................................................................................................................................... (Troiano, Pedersen, & Hornbaek, 2014). Deformable displays, also known as flexible displays, allow for new types of gestures that involve a more complex degree of interaction compared to a rigid touch screen (Ahmaniemi, Kildal, & Haveri, 2014;Steimle, Jordt, & Maes, 2013). A flexible display can be defined as an elastic material whose shape can be changed by applying a force to it, while a bend gesture is the physical deformation of a flexible device to form a curvature that triggers an action on a display (Lahey, Girouard, Burleson, & Vertegaal, 2011).…”