A multimodal tablet-based interface for designing and reviewing 3D engineering models

Abstract

The usage of multimodal user interfaces has revolutionized many different activities. However, most of the interactive technologies deployed in real world engineering contexts are still difficult to use, especially when engineering teams need to collaboratively visualize and review large-scale 3D CAD (Computer-Aided Design) models. This is the case of the oil platform industry, which necessarily involves the review and manipulation of large CAD models. In this paper we present a novel solution, based on multitouch and accelerometer input, which was designed and evaluated in close cooperation with researchers and engineers of a large oil industry company. We evaluated two different conditions: using multitouch-only input and using multitouch coupled with accelerometer-based input. Statistical analysis of quantitative data suggests that the second condition is faster and less error-prone than simply using multitouch-only input. Additionally, qualitative data showed that users perceive the multitouch-only interface as being more accurate, but more difficult to understand and use.

Lines, triangles, and nets: A framework for designing input technologies and interaction techniques for computer-aided design

“…A more conventional example that does not go beyond hand mediation is a tablet-based CAD interface that integrated multitouch and accelerometer input for reviewing large 3D models used in the oil–gas industry. 26 An interesting potential pointed out for the research work that aims at addressing the limitations of hand gesture recognition and touch is in speech-based input. One of the projects that taps into that potential is MozArt , a multitouch display that added support for speech—for commands such as circle, pull, undo, and top view—and finger gesture—two-finger pitch for zoom and single touch drag for specifying extent—input to Google SketchUp .…”