EyeExpression: exploring the use of eye expressions as hands-free input for virtual and augmented reality devices

Current virtual reality (VR) and augmented reality (AR) devices rely on handheld devices, hand gestures, head tracking, and voice input. This paper presents an initial exploration of using eye expressions as hands-free input modality for head-mounted AR/VR devices (HMDs). We consulted interaction designers and ophthalmologists and enumerated 12 eye expressions, and conducted a 12-person user study to better understand users' ability to perform them as well as preferences.