MagController: A System for Touchless Mobile Devices Control Using the Magnetic Field

A lot of improvements have been proposed in mobile computing devices, especially the wearable devices, in recent years. However, the input techniques remain a key challenge. One of the main methods for interacting with small screen devices today is the inflexible and error-prone touch-screen. In this paper, we propose MagController: a magnetic-based input technique that offers users wireless, unpowered, and high precision input for computing devices.The core idea is to leverage the triaxial magnetometer embedded in standard devices to accurately recognize a magnet different control actions. MagController also provides a number of modules that allow it to cope with background magnetic noise, heterogeneous devices, different magnet shapes, sizes, and strengths, as well as changes in magnet orientations.Our implementation of MagController on Android phones with extensive evaluation in wide range of environmental conditions scenarios shows that it can detect the magnet orientation with accuracy of more than 98%. In addition, MagController can recognize the magnetic actions with accuracy of 97% in different magnet’s orientations relative to the device. This accuracy is robust with different phones and magnets, highlighting MagController’s promise as an input technique for computing devices.

[1]  Chris Harrison,et al.  Abracadabra: wireless, high-precision, and unpowered finger input for very small mobile devices , 2009, UIST '09.

[2]  Khaled A. Harras,et al.  Wigest: A Ubiquitous Wifi-based Gesture Recognition System , 2014 .

[3]  Hamed Ketabdar,et al.  MagiWrite: towards touchless digit entry using 3D space around mobile devices , 2010, Mobile HCI.

[4]  Giovanni Vigna,et al.  ClearShot: Eavesdropping on Keyboard Input from Video , 2008, 2008 IEEE Symposium on Security and Privacy (sp 2008).

[5]  Khaled A. Harras,et al.  MagBoard: Magnetic-Based Ubiquitous Homomorphic Off-the-Shelf Keyboard , 2016, 2016 13th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON).

[6]  He Wang,et al.  MoLe: Motion Leaks through Smartwatch Sensors , 2015, MobiCom.

[7]  Sungjae Hwang,et al.  MagPen: magnetically driven pen interactions on and around conventional smartphones , 2013, MobileHCI '13.

[8]  Khaled A. Harras,et al.  WiGest demo: A ubiquitous WiFi-based gesture recognition system , 2015, 2015 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[9]  Yunhao Liu,et al.  Context-free Attacks Using Keyboard Acoustic Emanations , 2014, CCS.

[10]  Sean White,et al.  Nenya: subtle and eyes-free mobile input with a magnetically-tracked finger ring , 2011, CHI.

[11]  Wei Wang,et al.  Keystroke Recognition Using WiFi Signals , 2015, MobiCom.

[12]  Moustafa Youssef,et al.  Towards ubiquitous indoor spatial awareness on a worldwide scale , 2017, SIGSPACIAL.

[13]  H. Seki,et al.  Wearable handwriting input device using magnetic field , 2007, SICE Annual Conference 2007.