QoS Control and QoE Assessment in Multi-Sensory Communications with Haptics

Abstract

SUMMARYMulti-sensory communications with haptics attract a number of researchers in recent years. To provide services of the communications with high realistic sensations, the researchers focus on the quality of service (QoS) control, which keeps as high quality as possible, and the quality of experience (QoE) assessment, which is carried out to investigate the influence on user perception and to verify the effectiveness of QoS control. In this paper, we report the present status of studies on multisensory communications with haptics. Then, we divide applications of the communications into applications in virtual environments and those in real environments, and we mainly describe collaborative work and competitive work in each of the virtual and real environments. We also explain QoS control which is applied to the applications and QoE assessment carried out in them. Furthermore, we discuss the future directions of studies on multi-sensory communications.

Toward Haptic Communications Over the 5G Tactile Internet

“…A detailed description of QoS control methods has been given in [39], referring to traffic management, flow control, error control, ∆-causality control, other types of control and last but not least the aspect of synchronization of media streams. It is worth to mention that the authors of the paper also specify methods for estimating QoE.…”

QoS Control in Remote Robot Operation with Force Feedback

“…Recently, many researchers focus on studies of remote robot operation with force feedback in which a user operates a remote robot having force sensors by using a haptic interface device while monitoring the remote operations by a video camera [1][2][3]. By using force feedback, since users can touch remote objects and feel the shape, weight, and softness of each object, the efficiency and accuracy of operation can be largely improved [4]. Therefore, the remote robot operation with force feedback is expected to be used in many areas such as remote surgery, disaster rescue, and outer space.…”

“…Therefore, the remote robot operation with force feedback is expected to be used in many areas such as remote surgery, disaster rescue, and outer space. However, when the information about force and/or position is transmitted over a QoS (Quality of Service) [5] non-guaranteed network like the Internet, QoE (Quality of Experience) [6] may seriously deteriorate [3,4] owing to the network delay, delay jitter, and packet loss. Furthermore, as the network delay increases, the reaction force becomes larger, and unstable phenomena such vibrations of the robot and device may occur more often [7][8][9].…”

QoE Assessment of Fairness between Players in Networked Virtual 3D Objects Identification Game Using Haptic, Olfactory, and Auditory Senses

“…By using haptic and olfactory senses in addition to visual and auditory senses, various kinds of multisensory communications become utilizable for users at remote different places [1] [2] [3] [4]. With the advantage of multisensory communications, we can realize various applications such as networked games, arts, entertainment, and remote education with high sense of presence [5]- [10].…”