Eye-Gaze Tracking in Near-Eye Head-Mounted Displays

Existing near-eye microlens display designs do not account for variations in the user’s eye pose. This can lead to incorrectly rendered content thus degrading the overall experience. In this paper we describe the design of a microlens display equipped with an eye-gaze tracking camera. We describe how to calibrate the HMD so that the camera can be used for accurate 6DOF eye-pose estimation, present an approach to reduce the blur of presented images and present a method to simulate the user’s perception. Initial experiment results suggest that our approach provides a more accurate representation than images taken with a camera. In the future an evaluation of the system will provide important information for design of near-eye wide-field-of view HMDs. Author