Head Motion Tracking Through in-Ear Wearables

Head tracking is a fundamental component in visual attention detection, which, in turn, can improve the state of the art of hearing aid devices. A multitude of wearable devices for the ear (so called earables) exist. Current devices lack a magnetometer which, as we will show, represents a big challenge when one tries to use them for accurate head tracking. In this work we evaluate the performance of eSense, a representative earable device, to track head rotations. By leveraging two different streams (one per earbud) of inertial data (from the accelerometer and the gyroscope), we achieve an accuracy up to a few degrees. We further investigate the interference generated by a magnetometer in an earable to understand the barriers to its use in these types of devices.

[1]  Steven M. LaValle,et al.  Head tracking for the Oculus Rift , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Josh H. McDermott The cocktail party problem , 2009, Current Biology.

[3]  Chulhong Min,et al.  Exploring audio and kinetic sensing on earable devices , 2018, WearSys@MobiSys.

[4]  James Diebel,et al.  Representing Attitude : Euler Angles , Unit Quaternions , and Rotation Vectors , 2006 .

[5]  Chulhong Min,et al.  Earables for Personal-Scale Behavior Analytics , 2018, IEEE Pervasive Computing.

[6]  T. Dau,et al.  Improving Speech Intelligibility by Hearing Aid Eye-Gaze Steering: Conditions With Head Fixated in a Multitalker Environment , 2018, Trends in Hearing.

[7]  B. Shinn-Cunningham,et al.  Selective Attention in Normal and Impaired Hearing , 2008, Trends in amplification.

[8]  Gregory D. Abowd,et al.  EarBit: Using Wearable Sensors to Detect Eating Episodes in Unconstrained Environments , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[9]  W R Hamilton,et al.  Lectures on Quaternions: Contaning a Systematic Statement of a New Mathematical Method , 1853 .

[10]  Romit Roy Choudhury,et al.  Closing the Gaps in Inertial Motion Tracking , 2018, MobiCom.

[11]  Paul Lukowicz,et al.  Analysis of Chewing Sounds for Dietary Monitoring , 2005, UbiComp.

[12]  Thomas B. Schön,et al.  Using Inertial Sensors for Position and Orientation Estimation , 2017, Found. Trends Signal Process..

[13]  Steven Francis Leboeuf,et al.  Earbud-based sensor for the assessment of energy expenditure, HR, and VO2max. , 2014, Medicine and science in sports and exercise.

[14]  Mo Li,et al.  Use it free: instantly knowing your phone attitude , 2014, MobiCom.