The head mouse — Head gaze estimation "In-the-Wild" with low-cost inertial sensors for BMI use

We present a wearable head-tracking device using inexpensive inertial sensors as an alternative head movement tracking system. This can be used as indicator of human movement intentions for Brain-Machine Interface (BMI) applications. Our system is capable of tracking head movements at high rates (100 Hz) and achieves R2 = 0.99 with a 2.5° RMSE against a ground-truth motion tracking system. The system tracks head movements over periods in the order of tens of minutes with little drift. The accuracy and precision of our system, together with its low response latency of ≈ 20 ms make it an unconventional but effective system for human-computer interfacing: the "head mouse" controls the mouse cursor on a display based on head orientation alone, so that it matches the centre of a straight-onward looking user. Our head mouse is suitable for amputees and spinal chord injury patients who have lost control of their upper extremities. We show that naive test subjects are capable to write text using our system and an on-screen keyboard at a rate of 4.65 words/minute, compared to able bodied users using a physical computer mouse which reached 7.85 words/minute. Crucially we measure the natural head movements of able bodied computer users, and show that our approach falls within the range of natural head movement parameters.

[1]  M. Hayhoe,et al.  The coordination of eye, head, and hand movements in a natural task , 2001, Experimental Brain Research.

[2]  Mohan M. Trivedi,et al.  Head Pose Estimation in Computer Vision: A Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Greg Welch,et al.  Welch & Bishop , An Introduction to the Kalman Filter 2 1 The Discrete Kalman Filter In 1960 , 1994 .

[4]  Eduardo Rocon,et al.  Wearable inertial mouse for children with physical and cognitive impairments , 2010 .

[5]  S. Glasauer,et al.  Optimal Control of Natural Eye-Head Movements Minimizes the Impact of Noise , 2011, The Journal of Neuroscience.

[6]  Evelyn Z. McClave.  Linguistic functions of head movements in the context of speech , 2000 .

[7]  Dean J Krusienski,et al.  Brain-computer interfaces in medicine. , 2012, Mayo Clinic proceedings.

[8]  Luca Citi,et al.  Defining brain–machine interface applications by matching interface performance with device requirements , 2008, Journal of Neuroscience Methods.

[9]  J. W. Humberston.  Classical mechanics , 1980, Nature.

[10]  Constantinos Gavriel,et al.  Wireless kinematic body sensor network for low-cost neurotechnology applications “in-the-wild” , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[11]  John Paulin Hansen,et al.  Gaze typing compared with input by head and hand , 2004, ETRA.

[12]  S. Ueda,et al.  Functional deterioration in adults with cerebral palsy. , 2000, Clinical rehabilitation.

[13]  W W Abbott,et al.  Ultra-low-cost 3D gaze estimation: an intuitive high information throughput compliment to direct brain–machine interfaces , 2012, Journal of neural engineering.

[14]  Peng Liu,et al.  3D Head Pose Estimation Based on Scene Flow and Generic Head Model , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[15]  Wang Yu,et al.  Head Pose Estimation Based on Head Tracking and the Kalman Filter , 2011 .

[16]  José Luis Pons Rovira,et al.  A Robust Kalman Algorithm to Facilitate Human-Computer Interaction for People with Cerebral Palsy, Using a New Interface Based on Inertial Sensors , 2012, Sensors.