Illuminated Focus: Vision Augmentation using Spatial Defocusing via Focal Sweep Eyeglasses and High-Speed Projector

Abstract

Fig. 1. The IlluminatedFocus technique optically defocuses real-world appearances in a spatially varying manner regardless of the distance from the user's eyes to observed real objects. The proposed technique enables various vision augmentation applications. (a) The proposed system consists of focal sweep eyeglasses (two Electrically Focus-Tunable Lenses (ETL)) and a high-speed projector. (b) Experimental proof of the proposed technique. (b-1) Experimental setup. Four objects (A, B, C, and D) are placed in front of the projector and ETL. A camera is regarded as a user's eye. (b-2, b-3, b-4) The objects are illuminated by the projector at different timings and the camera's focal length is periodically modulated by the ETL. As indicated by the yellow arrows, objects to appear focused (A, C, and D) are illuminated when they are in focus and the other object to appear blurred (B) is illuminated when it is out of focus. (b-5) When the frequency of the focal sweep is higher than the critical fusion frequency (CFF), these appearances are perceived to be integrated. The appearance of this image (only B is blurred) cannot be achieved by normal lens systems. Note that the brightness of (b-2) to (b-5) has been adjusted for better understanding.Abstract-Aiming at realizing novel vision augmentation experiences, this paper proposes the IlluminatedFocus technique, which spatially defocuses real-world appearances regardless of the distance from the user's eyes to observed real objects. With the proposed technique, a part of a real object in an image appears blurred, while the fine details of the other part at the same distance remain visible. We apply Electrically Focus-Tunable Lenses (ETL) as eyeglasses and a synchronized high-speed projector as illumination for a real scene. We periodically modulate the focal lengths of the glasses (focal sweep) at more than 60 Hz so that a wearer cannot perceive the modulation. A part of the scene to appear focused is illuminated by the projector when it is in focus of the user's eyes, while another part to appear blurred is illuminated when it is out of the focus. As the basis of our spatial focus control, we build mathematical models to predict the range of distance from the ETL within which real objects become blurred on the retina of a user. Based on the blur range, we discuss a design guideline for effective illumination timing and focal sweep range. We also model the apparent size of a real scene altered by the focal length modulation. This leads to an undesirable visible seam between focused and blurred areas. We solve this unique problem by gradually blending the two areas. Finally, we demonstrate the feasibility of our proposal by implementing various vision augmentation applications.Index Terms-Vision augmentation, spatial defocusing, depth-of-field, focal sweep, high-speed projection, spatial augmented reality • Daisuke Iwai is with Osaka University and JST, PRESTO.

Multifocal Stereoscopic Projection Mapping

“…Finally, we validated the advantage provided by our technique with regard to the mitigation of the VAC by comparing it with conventional stereoscopic PM using a user study of a depth-matching task. A new branch of research associated with AR/VR displays has recently been enabled by the combination of projectors and near-eye optics [27,70,71], and this work can be categorized with the same. We will continue to investigate the possibility and applicability of this emerging framework.…”

Projection mapping technologies: A review of current trends and future directions

“…Ueda et al proposed using a high-speed projector to illuminate a real scene rather than overlaying images onto it. This approach allows for spatially non-uniformly defocused real-world appearances, irrespective of the distance from the user’s eyes to observed real objects 128 ) (Fig. 6 ).…”

“… (Color online) Combining near-eye optics with a high-speed projector enables spatially non-uniformly defocused real-world appearances. 128 ) (a, b) Two ETLs, capable of quick focus modulation, are used as eyeglasses. (c) The appearance of a music score without the eyeglasses, and (d) with the eyeglasses, where a spatially non-uniform blurring effect guides a player at a fixed tempo.…”

Multielectrode Balloon-type Dielectric Elastomer Actuator for 3-Degrees-of-Freedom Lens Actuation

“…The use of an actuation mechanism to regulate optical elements is attractive for framing cells and microorganisms 1,2 , tracking affected tissues during surgery 3 , augmenting human eye functions 4 , and developing biomimetic optical devices 5,6 . In particular, miniature tunable lens systems are useful for microscopic imaging applications.…”