JINSense: Repurposing Electrooculography Sensors on Smart Glass for Midair Gesture and Context Sensing

In this work, we explore a new sensing technique for smart eyewear equipped with Electrooculography (EOG) sensors. We repurpose the EOG sensors embedded in a JINS MEME smart eyewear, originally designed to detect eye movement, to detect midair hand gestures. We also explore the potential of sensing human proximity, rubbing action and to differentiate materials and objects using this sensor. This new found sensing capabilities enable a various types of novel input and interaction scenarios for such wearable eyewear device, whether it is worn on body or resting on a desk.

[1]  Kai Kunze,et al.  Smooth eye movement interaction using EOG glasses , 2016, ICMI.

[2]  Patrick Schrempf,et al.  RadarCat: Radar Categorization for Input & Interaction , 2016, UIST.

[3]  Ivan Poupyrev,et al.  Soli , 2016, ACM Trans. Graph..

[4]  Kai Kunze,et al.  MEME: eye wear computing to explore human behavior , 2015, UbiComp/ISWC Adjunct.

[5]  Kai Kunze,et al.  The wordometer 2.0: estimating the number of words you read in real life using commercial EOG glasses , 2016, UbiComp Adjunct.

[6]  Kai Kunze,et al.  Solar system: smooth pursuit interactions using EOG glasses , 2016, UbiComp Adjunct.

[7]  Yuji Uema,et al.  JINS MEME algorithm for estimation and tracking of concentration of users , 2017, UbiComp/ISWC Adjunct.

[8]  Kai Kunze,et al.  EOG Glasses: an Eyewear Platform for Cognitive and Social Interaction Assessments in the Wild , 2019, MobileHCI.

[9]  Yuji Uema,et al.  Measuring Study Activity across High School Students Using Commercial EOG Glasses , 2018, UbiComp/ISWC Adjunct.

[10]  Kai Kunze,et al.  Smarter eyewear: using commercial EOG glasses for activity recognition , 2014, UbiComp Adjunct.

[11]  Kai Kunze,et al.  MEME: smart glasses to promote healthy habits for knowledge workers , 2015, SIGGRAPH Emerging Technologies.

[12]  Kai Kunze,et al.  Eye blink as an input modality for a responsive adaptable video system , 2016, UbiComp Adjunct.

[13]  Kai Kunze,et al.  Continuous Alertness Assessments: Using EOG Glasses to Unobtrusively Monitor Fatigue Levels In-The-Wild , 2019, CHI.

[14]  Kai Kunze,et al.  Itchy nose: discreet gesture interaction using EOG sensors in smart eyewear , 2017, SEMWEB.

[15]  Gerhard Tröster,et al.  Wearable EOG goggles: eye-based interaction in everyday environments , 2009, CHI Extended Abstracts.