Immersive human machine interface for controlling the operation of the Telerescuer robot

Abstract

Abstract-The paper presents the modes of operation of Telerescuer robot controlled by an innovative human-machine interface. The robot is designed to perform inspections during the rescue actions in subterranean areas of the coal mines affected by catastrophic events. In order to make navigation of the robot as simple as possible, the immersive human-machine interface has been developed, whose purpose is not only to navigate, but also to supervise semi-autonomous mission of the robot. In addition, the paper presents experiments with triangulation of the point clouds resulting from the 3D scanner installed on the robot as well as architecture of other main components of the whole Telerescuer system, developed in collaboration of academic and industrial partners from Poland, Czech Republic and Spain.

A hierarchy of finite state machines as a scenario player in interactive training of pilots in flight simulators

“…Over time, the AR or assisted reality technologies have been used not only for maintenance repair or operation performed by technical staff. They can be also utilized to virtually 'teleport' the distant environment of interest where some object (e.g., a vehicle or a UAV) operates, and to immerse it in a selected space of the real environment of the operator (Cyran et al, 2018a;2018b).…”