An optical see-through head-mounted display (OST-HMD), which enables optical superposition of digital information onto the direct view of the physical world and maintains see-through vision to the real world, is a vital component in an augmented reality (AR) system. A key limitation of the state-of-the-art OST-HMD technology is the well-known accommodation-convergence mismatch problem caused by the fact that the image source in most of the existing AR displays is a 2D flat surface located at a fixed distance from the eye. In this paper, we present an innovative approach to OST-HMD designs by combining the recent advancement of freeform optical technology and microscopic integral imaging (micro-InI) method. A micro-InI unit creates a 3D image source for HMD viewing optics, instead of a typical 2D display surface, by reconstructing a miniature 3D scene from a large number of perspective images of the scene. By taking advantage of the emerging freeform optical technology, our approach will result in compact, lightweight, goggle-style AR display that is potentially less vulnerable to the accommodation-convergence discrepancy problem and visual fatigue. A proof-of-concept prototype system is demonstrated, which offers a goggle-like compact form factor, non-obstructive see-through field of view, and true 3D virtual display.

It has been a challenge to design an optical see-through head-mounted display (OST-HMD) that has a wide field of view (FOV) and low f-number (f/#) while maintaining a compact, lightweight, and nonintrusive form factor. In this paper, we present an OST-HMD design using a wedge-shaped freeform prism cemented with a freeform lens. The prism, consisting of three freeform surfaces (FFSs), serves as the near-eye viewing optics that magnifies the image displayed through a microdisplay, and the freeform lens is an auxiliary element attached to the prism in order to maintain a nondistorted see-through view of a real-world scene. Both the freeform prism and the lens utilize plastic materials to achieve light weight. The overall dimension of the optical system per eye is no larger than 25 mm by 22 mm by 12 mm, and the weight is 8 g. Based on a 0.61 in. microdisplay, our system demonstrates a diagonal FOV of 53.5 degrees and an f/# of 1.875, with an 8 mm exit pupil diameter and an 18.25 mm eye relief.

Lack of accurate focus cues in conventional stereoscopic displays has potentially significant effects on depth perception accuracy and visual fatigue. Recently several multi-focal plane display prototypes have been demonstrated with the promise of improving the accuracy of focus cue rendering in stereoscopic displays. In this paper, we present a systematic method to address two fundamental issues in designing a multi-focal plane display: (1) the appropriate dioptric spacing between adjacent focal planes; and (2) the depth-weighted fusing function to render a continuous three-dimensional (3-D) volume using a sparse number of focal planes placed in the space. By taking account of both ocular factors of the human visual system (HVS) and display factors of a multi-focal plane system, we determine that an appropriate spacing between two adjacent focal planes should be ~0.6 diopter (D) while a smaller spacing may be necessary for further improving retinal image quality. We further develop a set of nonlinear depth-weighted fusing function with the promise of balancing perceptual continuity of a 3-D scene and retinal image quality. Our method was based on quantitative evaluation of the modulation transfer functions (MTF) of depth-fused images formed on retina.

Conventional stereoscopic displays force an unnatural decoupling of the accommodation and convergence cues, which may contribute to various visual artifacts and have adverse effects on depth perception accuracy. In this paper, we present the design and implementation of a high-resolution optical see-through multi-focal-plane head-mounted display enabled by state-of-the-art freeform optics. The prototype system is capable of rendering nearly-correct focus cues for a large volume of 3D space, extending into a depth range from 0 to 3 diopters. The freeform optics, consisting of a freeform prism eyepiece and a freeform lens, demonstrates an angular resolution of 1.8 arcminutes across a 40-degree diagonal field of view in the virtual display path while providing a 0.5 arcminutes angular resolution to the see-through view.

One of the key issues in conventional stereoscopic displays is the well-known vergence-accommodation conflict problem due to the lack of the ability to render correct focus cues for 3D scenes. Recently several light field display methods have been explored to reconstruct a true 3D scene by sampling either the projections of the 3D scene at different depths or the directions of the light rays apparently emitted by the 3D scene and viewed from different eye positions. These methods are potentially capable of rendering correct or nearly correct focus cues and addressing the vergence-accommodation conflict problem. In this paper, we describe a generalized framework to model the image formation process of the existing light-field display methods and present a systematic method to simulate and characterize the retinal image and the accommodation response rendered by a light field display. We further employ this framework to investigate the trade-offs and guidelines for an optimal 3D light field display design. Our method is based on quantitatively evaluating the modulation transfer functions of the perceived retinal image of a light field display by accounting for the ocular factors of the human visual system.

Head-mounted projective displays (HMPD's) are a novel type of head-mounted display. A HMPD consists of a miniature projection lens mounted upon the user's head and retroreflective sheeting material placed strategically in the environment. First, the imaging concept of a HMPD is reviewed and its potential advantages and disadvantages are discussed. The design and a bench prototype implementation are then presented. Finally, the effects of retroreflective materials on the imaging properties and the optical properties of HMPD's are comprehensively investigated.

No abstract

Focus cues play a significant role in three-dimensional (3-D) depth perception. Conventional stereoscopic displays, however, lack the ability to correctly render these cues, because they present a pair of stereoscopic images on a fixed image plane while forcing the eyes to converge at different distances to view objects at different depths. Using a fast liquid-lens device, we present the design and implementation of a time-multiplexed dual-focal plane display that is capable of rendering correct or near-correct focus cues as well as other depth cues, such as occlusion and shading for a 3-D scene. The focus range of the dual focal planes can vary from infinity to as close as 8 diopters. Two driving mechanisms are proposed to render near-correct focus cues and their effects on image sharpness, flicker, and brightness are compared.