Real-Time Gaze Tracking with Event-Driven Eye Segmentation

Abstract

Workflow of our gaze tracking algorithm. The algorithm provides an Auto ROI mode (akin to the conventional "3A" algorithms in a camera) by emulating an event camera in software and using the events to predict the Region of Interest (ROI). Performing Auto ROI in emerging compute-capable image sensors further reduces the data transmission energy. Right: Our algorithm achieves sub-0.5°gaze accuracies (both horizontal and vertical directions) using only 30K parameters, an order of magnitude smaller than other algorithms. Marker sizes in the figure are proportional to the number of parameters. The algorithm operates at over 30 Hz on a mobile Jetson Xavier processor.