WiWrite: Wi-Fi Based Handwriting Recognition like Playing Lego

Effective finger writing underpins semantic text input task for virtual reality applications. We demonstrate WiWrite, a novel finger writing system that leverages the ubiquitous wireless signals to enable character recognition and word estimation. WiWrite decomposes characters into basic strokes and distinguishes them by exploring the unique signal reflection pattern caused by finger movements. Apart from the prior arts relying on specialized sensors or wearable devices, WiWrite is device-free without any accessories in deed. Our real-world experiments in two different scenarios show that WiWrite succeeds in classifying 26 upper-case alphabets with 90.8% average accuracy and recognizing simple words with an average accuracy of 96.7%.

[1]  Li Sun,et al.  WiDraw: Enabling Hands-free Drawing in the Air on Commodity WiFi Devices , 2015, MobiCom.

[2]  Shwetak N. Patel,et al.  Whole-home gesture recognition using wireless signals , 2013, MobiCom.

[3]  Bo Chen,et al.  Tracking Keystrokes Using Wireless Signals , 2015, MobiSys.

[4]  Yang Xu,et al.  WiFinger: talk to your smart devices with finger-grained gesture , 2016, UbiComp.

[5]  Desney S. Tan,et al.  FingerIO: Using Active Sonar for Fine-Grained Finger Tracking , 2016, CHI.

[6]  Thierry Bouwmans,et al.  Robust PCA via Principal Component Pursuit: A review for a comparative evaluation in video surveillance , 2014, Comput. Vis. Image Underst..

[7]  Xiang-Yang Li,et al.  Word-Fi: Accurate Handwrite System Empowered by Wireless Backscattering and Machine Learning , 2018, IEEE Network.

[8]  Shiwen Mao,et al.  CSI Phase Fingerprinting for Indoor Localization With a Deep Learning Approach , 2016, IEEE Internet of Things Journal.

[9]  Kaishun Wu,et al.  WiFall: Device-free fall detection by wireless networks , 2017, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[10]  Jian Liu,et al.  Multi - Touch in the Air: Device-Free Finger Tracking and Gesture Recognition via COTS RFID , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[11]  Shan Chang,et al.  $\pi$ -Splicer: Perceiving Accurate CSI Phases with Commodity WiFi Devices , 2018, IEEE Transactions on Mobile Computing.

[12]  Lu Wang,et al.  FIMD: Fine-grained Device-free Motion Detection , 2012, 2012 IEEE 18th International Conference on Parallel and Distributed Systems.

[13]  Lei Jing,et al.  Threshold selection and adjustment for online segmentation of one-stroke finger gestures using single tri-axial accelerometer , 2014, Multimedia Tools and Applications.

[14]  Panlong Yang,et al.  WordRecorder: Accurate Acoustic-based Handwriting Recognition Using Deep Learning , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[15]  Sheng Tan,et al.  WiFinger: leveraging commodity WiFi for fine-grained finger gesture recognition , 2016, MobiHoc.

[16]  David Wetherall,et al.  Tool release: gathering 802.11n traces with channel state information , 2011, CCRV.

[17]  Jue Wang,et al.  RF-IDraw: virtual touch screen in the air using RF signals , 2015, SIGCOMM 2015.

[18]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[19]  Junbo Wang,et al.  Magic Ring: a self-contained gesture input device on finger , 2013, MUM.

[20]  Wei Wang,et al.  Keystroke Recognition Using WiFi Signals , 2015, MobiCom.

[21]  Steve Chang.  InfraNotes: Inconspicuous Handwritten Trajectory Tracking for Lecture Note Recording with Infrared Sensors , 2016, ArXiv.

[22]  Khaled A. Harras,et al.  Wigest: A Ubiquitous Wifi-based Gesture Recognition System , 2014 .

[23]  Amber Dailey-Hebert,et al.  Emerging Tools and Applications of Virtual Reality in Education , 2016 .

[24]  Khaled A. Harras,et al.  WiGest demo: A ubiquitous WiFi-based gesture recognition system , 2015, 2015 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[25]  Yunhao Liu,et al.  PADS: Passive detection of moving targets with dynamic speed using PHY layer information , 2014, 2014 20th IEEE International Conference on Parallel and Distributed Systems (ICPADS).

[26]  Chi Zhang,et al.  Extending Mobile Interaction Through Near-Field Visible Light Sensing , 2015, MobiCom.

[27]  Shaojie Tang,et al.  SoundWrite: Text Input on Surfaces through Mobile Acoustic Sensing , 2015, SmartObjects '15.

[28]  Liang Wang,et al.  Structure-Based Statistical Features and Multivariate Time Series Clustering , 2007, Seventh IEEE International Conference on Data Mining (ICDM 2007).