Gaze Tracking and Point Estimation Using Low-Cost Head-Mounted Devices

Abstract

In this study, a head-mounted device was developed to track the gaze of the eyes and estimate the gaze point on the user’s visual plane. To provide a cost-effective vision tracking solution, this head-mounted device is combined with a sized endoscope camera, infrared light, and mobile phone; the devices are also implemented via 3D printing to reduce costs. Based on the proposed image pre-processing techniques, the system can efficiently extract and estimate the pupil ellipse from the camera module. A 3D eye model was also developed to effectively locate eye gaze points from extracted eye images. In the experimental results, average accuracy, precision, and recall rates of the proposed system can achieve an average of over 97%, which can demonstrate the efficiency of the proposed system. This study can be widely used in the Internet of Things, virtual reality, assistive devices, and human-computer interaction applications.

Emerging Sensing Technologies in Consumer Electronics

“…Based on the proposed image pre-processing techniques, the system can efficiently extract and estimate the pupil ellipse from the camera module [15]. A 3D eye model was also developed to effectively locate eye gaze points from extracted eye images [15]. In the experimental results, average accuracy, precision, and recall rates of the proposed system can achieve an average of over 97%, which can demonstrate the efficiency of the proposed system [15].…”

“…Besides, K.-F. Lee et al aimed to perform gaze tracking and point estimation using low-cost head-mounted devices [15]. To provide a cost-effective vision tracking solution, this head-mounted device is combined with a sized endoscope camera, infrared light, and mobile phone; the devices are also implemented via 3D printing to reduce costs [15]. Based on the proposed image pre-processing techniques, the system can efficiently extract and estimate the pupil ellipse from the camera module [15].…”

“…To provide a cost-effective vision tracking solution, this head-mounted device is combined with a sized endoscope camera, infrared light, and mobile phone; the devices are also implemented via 3D printing to reduce costs [15]. Based on the proposed image pre-processing techniques, the system can efficiently extract and estimate the pupil ellipse from the camera module [15]. A 3D eye model was also developed to effectively locate eye gaze points from extracted eye images [15].…”

ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays

“…Stratmann et al [ 8 ] presented EyeMR, a low-cost system for integrating eye tracking into VR based on the Pupil Capture software and a custom Unity 3D framework. Lee et al [ 9 ] also presented a method for low-cost gaze tracking and gaze point estimation in head-mounted devices. Mardanbegi and Pfeiffer [ 10 ] presented the EyeMRTK toolkit to develop gaze-based interaction techniques in VR and AR; however, the current implementation is limited to specific VR headsets.…”

Hands-Free User Interface for VR Headsets Based on In Situ Facial Gesture Sensing

“…Several researchers have investigated human eye movement using multimodal sensors, including eye or gaze trackers [ 3 , 4 , 5 , 6 ]. As shown in Table 1 , some researchers have integrated gaze tracking into a near-eye viewing device [ 7 ], endoscope camera [ 8 ], or head-mounted display (HMD) environment [ 9 ] to create a hands-free input interface. Many different hand gesture interfaces have been proposed in literature.…”