3D object modeling using spatial and pictographic gestures

Abstract

1. ABSTRACT While many sophisticated 3D rendering methods are available to produce realistic output, 3D data input still is a tedious and time-consuming task. This paper proposes a new method for modeling 3D objects using hand gestures. First of all, a conceptual model, the so-called "image externalization loop" model, is introduced as a framework to realize an efficient 3D object creation environment. Then, a 3D shape forming method for implementing the model is described in detail. Two-handed spatial and pictographic gestures are used to describe the features of the object in shape, size and deformation pattern. The implicit superquadric functions apply to build a deformable 3D model with blending and axial deformations as their extensions. A generic hand gesture learning and recognition facility is developed and used to translate the gestures into specific superquadrics parameters to deform the object. Finally, some experimental results are shown to express the capability and usefulness of the proposed method with its potentia! application areas.

MixFab

“…Some let users deform models using both hands [20,17]; others use the motion of the hand [24] or its curvature [12] to define the shape.…”

“…In previous work, hand gestures are typically defined by the respective authors, rather than users [14,20]. We are interested in what gestures users would intuitively perform to create and manipulate objects, also to inform our subsequent system design.…”

An inflatable hemispherical multi-touch display

“…To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. In the past, the editing of 3-D objects by direct gestural interaction has been studied for regular planar interfaces [12,16] and there has been work with motion-captured gestures to edit 3-D objects displayed on a separated flat surface [18] or on a 3-D volumetric Actuality Perspecta display [5]. Sheng et al [18] examined the use of a physical object, such as a sponge, as a proxy for the user to hold and deform while gestures were detected via motion-capture.…”

Data miming

“…While some systems allow the user to shape and transform 3D objects using their hands (e.g., Gesture-based 3D modeling [19], SketchMaker [22], Twister [17], Surface Drawing [24]), others equip the user's hands with tools (e.g., Volume sculpting [28], heat gun and sandpaper in Sculpting [8]). Other systems derive 3D models from the user's sketches in the air using a stylus (e.g., 3-Draw [23], Spatial Sketch [29], HoloSketch [5]).…”