UniverSense: IoT Device Pairing through Heterogeneous Sensing Signals

Easily establishing pairing between Internet-of-Things (IoT) devices is important for fast deployment in many smart home scenarios. Traditional pairing methods, including passkey, QR code, and RFID, often require specific user interfaces, surface's shape/material, or additional tags/readers. The growing number of low-resource IoT devices without an interface may not meet these requirements, which makes their pairing a challenge. On the other hand, these devices often already have sensors embedded for sensing tasks, such as inertial sensors. These sensors can be used for limited user interaction with the devices, but are not suitable for pairing on their own. In this paper, we present UniverSense, an alternative pairing method between low-resource IoT devices with an inertial sensor and a more powerful networked device equipped with a camera. To establish pairing between them, the user moves the low-resource IoT device in front of the camera. Both the camera and the on-device sensors capture the physical motion of the low-resource device. UniverSense converts these signals into a common state-space to generate fingerprints for pairing. We conduct real-world experiments to evaluate UniverSense and it achieves an F1 score of 99.9% in experiments carried out by five participants.

[1]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Shusen Yang,et al.  Rapid, User-Transparent, and Trustworthy Device Pairing for D2D-Enabled Mobile Crowdsourcing , 2017, IEEE Transactions on Mobile Computing.

[3]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Erik C. Rye,et al.  A Study of MAC Address Randomization in Mobile Devices and When it Fails , 2017, Proc. Priv. Enhancing Technol..

[5]  Ahmad-Reza Sadeghi,et al.  Context-Based Zero-Interaction Pairing and Key Evolution for Advanced Personal Devices , 2014, CCS.

[6]  ZhangZhengyou A Flexible New Technique for Camera Calibration , 2000 .

[7]  Andy Barnhart In the palm of your hand , 1997 .

[8]  Xiao Wang,et al.  Convoy: Physical Context Verification for Vehicle Platoon Admission , 2017, HotMobile.

[9]  Xiaohui Liang,et al.  Wanda: Securely introducing mobile devices , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[10]  Pedro Neto,et al.  3-D position estimation from inertial sensing: Minimizing the error from the process of double integration of accelerations , 2013, IECON 2013 - 39th Annual Conference of the IEEE Industrial Electronics Society.

[11]  Lujo Bauer,et al.  Don't Bump, Shake on It: the exploitation of a popular accelerometer-based smart phone exchange and its secure replacement , 2011, ACSAC '11.

[12]  Peter Fröhlich,et al.  The Screen Is Yours - Comparing Handheld Pairing Techniques for Public Displays , 2013, AmI.

[13]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Nasser Kehtarnavaz,et al.  Home-based Senior Fitness Test measurement system using collaborative inertial and depth sensors , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[15]  Jesse S. Jin,et al.  Tracking Using CamShift Algorithm and Multiple Quantized Feature Spaces , 2004, VIP.

[16]  Jukka Riekki,et al.  Requesting Pervasive Services by Touching RFID Tags , 2006, IEEE Pervasive Computing.

[17]  Stefan Mangold,et al.  RFID shakables: pairing radio-frequency identification tags with the help of gesture recognition , 2013, CoNEXT.

[18]  A. Savitzky,et al.  Smoothing and Differentiation of Data by Simplified Least Squares Procedures. , 1964 .

[19]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Christof Paar,et al.  Authenticated key establishment for low-resource devices exploiting correlated random channels , 2016, Comput. Networks.

[21]  Rui Caseiro,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence High-speed Tracking with Kernelized Correlation Filters , 2022 .

[22]  J. Farrell,et al.  The global positioning system and inertial navigation , 1999 .

[23]  Patrick Tague,et al.  IdentityLink: user-device linking through visual and RF-signal cues , 2014, UbiComp.