Effect of the ratio difference of overlapped areas of stereoscopic images on each eye in a teleoperation

Abstract

It is reported that the efficiency of a teleoperation in stereoscopic images of the working site is lower than that in the direct viewing of the site. It is assumed that one of the causes of lower efficiency of the teleoperation in the stereoscopic images would be the difficulty ofthe fusion of images, which would be caused by the imperfect overlapping ofimages on each eye. Through most of a teleoperation the convergence of the stereoscopic cameras is fixed at a certain point, usually in the middle of the working area. When the plane of the operator's eye-fixation-point is apart from the plane of the convergence point of the stereoscopic cameras, the two images do not overlap perfectly. It requires a great deal of effort for the images to be fused when the difference ofthe depth oftwo planes is over a certain value. We hypothesized that imperfect overlapping ofthe images on the left and right eyes would cause a decrease in efficiency for a teleoperation. We examined the efficiency of a teleoperation in two kinds of camera convergence conditions in a virtual reality (VR) environment. (Condition 1): The convergence point of two cameras was set on the target object which subjects moved and inserted in a hole. When the convergence point of the cameras follows the point on the target object on which subjects fixate with their both eyes, the ratio of the overlapped area of two images is always nearly at maximum. (Condition 2): The convergence point of both cameras is not set on the target object, but at the center of the hole-base. The larger the difference between the plane of the camera's convergence point and the plane ofthe subject's fixation point becomes, the more the rate ofthe overlapped area of the two images decreases. We prepared four cylinders and a hole-base with four holes in which the cylinders were inserted. The subject was asked to insert a cylinder in a hole using a three-dimensional mouse which allows free movement in the VR space. We measured the completion times of the operation and the number of errors in each condition to evaluate the efficiency of the operation. As a result of the experiment, the completion times of the operation and the number of errors under nearly-perfectly overlapped conditions were significantly smaller than the ones under the conditions in which the overlapping is less than maximum value. The experiment revealed work performance decreased when the ratio of overlapping of two images, which were projected on each eye, is less than maximum value. These results led to the conclusion that in order to achieve good performance in a teleoperation, the convergence point ofthe cameras should follow the target object on which subjects fixate with their both eyes.

<title>Effect of overlap rate between stereoscopic images on performance in a teleoperation</title>

“…The visual system of the observer had to make up or ignore the deficits. Our previous simulation experiment showed that the low overlap rate brought low performance in pick-and-insert task as we anticipated 3) . In this paper we did an experiment using the actual stereoscopic video system.…”

The Role of Camera Convergence in Stereoscopic Video See-through Augmented Reality Displays

“…in the personal space, at arm's length) and during procedures that demands for high dexterity as a surgical tasks. It is our conviction that this requirement, once achieved, may fully compensate for the increased distortion of the perceived 3D space, due to the dynamic change of the convergence of the cameras (be them virtual or real) [37]. In our opinion, from a functional standpoint, resolving diplopia has a higher priority than dealing with the perceptual artefacts caused to the non-rigorous orthoscopy of the stereoscopic display.…”

Toed-in vs Parallel Displays in Video See-Through Head-Mounted Displays for Close-Up View

“…To cope with this, both hardware and software solutions have been proposed [30]. As an example of a hardware solution, the excessive retinal disparity can be overcome by physically converging the cameras [31], [32] so as to increase the overlapping zones between the left and right images and thus yielding a correct stereoscopic vision even of the closest objects without diplopia. However, as previously mentioned, the optical axes of cameras and displays need to be coincident to prevent geometric and stereoscopic distortions, such as keystone distortion and depth plane curvature.…”