Human–Machine Interaction Method of Virtual Assembly

Abstract

Virtual assembly human-computer interaction is a kind of interactive action matching with the characteristics of Three-dimensional environment itself, which enables users to get a direct immersive feeling in the virtual scene. In the virtual reality assembly system for coal machine equipment, various human-computer interaction devices are used to enable designers and researchers of coal machine equipment to interact with the system with more abundant means, so as to find the problems existing in the equipment and provide strong technical support for equipment improvement and new product research and development.Three-dimensional interaction technology is a "control-display" mapping relationship, user devices (such as mouse, keyboard, data gloves, force feedback device, etc.) input control information to the system, and then the system output the execution results to the user. There are many tasks involved in 3D interaction, and the main human-machine interaction in this system is assembly interaction. The assembly interaction is achieved through three methods: one is based on the traditional mouse and keyboard through the operator or robot to realize the full-scale browsing of the scene to realize the interaction; the second is based on the data glove and the position tracker to realize the interaction, the last one is a human-computer interaction technology which is based on force feedback. The specific implementations of these interaction modes will be introduced below. Mouse and Keyboard Human-Computer Interaction Scene Interaction Based on TrackballThe assembly scene interaction does not refer to the operation of the entire assembly scene (including the objects in it), but to change the position of the camera or observer