FG-LiquID

Contact-less liquid identification via wireless sensing has diverse potential applications in our daily life, such as identifying alcohol content in liquids, distinguishing spoiled and fresh milk, and even detecting water contamination. Recent works have verified the feasibility of utilizing mmWave radar to perform coarse-grained material identification, e.g., discriminating liquid and carpet. However, they do not fully exploit the sensing limits of mmWave in terms of fine-grained material classification. In this paper, we propose FG-LiquID, an accurate and robust system for fine-grained liquid identification. To achieve the desired fine granularity, FG-LiquID first focuses on the small but informative region of the mmWave spectrum, so as to extract the most discriminative features of liquids. Then we design a novel neural network, which uncovers and leverages the hidden signal patterns across multiple antennas on mmWave sensors. In this way, FG-LiquID learns to calibrate signals and finally eliminate the adverse effect of location interference caused by minor displacement/rotation of the liquid container, which ensures robust identification towards daily usage scenarios. Extensive experimental results using a custom-build prototype demonstrate that FG-LiquID can accurately distinguish 30 different liquids with an average accuracy of 97%, under 5 different scenarios. More importantly, it can discriminate quite similar liquids, such as liquors with the difference of only 1% alcohol concentration by volume.

[1]  Xiaonan Guo,et al.  MU-ID: Multi-user Identification Through Gaits Using Millimeter Wave Radios , 2020, IEEE INFOCOM 2020 - IEEE Conference on Computer Communications.

[2]  Ivan Poupyrev,et al.  Soli , 2016, ACM Trans. Graph..

[3]  Shaoyuan Yang,et al.  Robotic Millimeter-Wave Wireless Networks , 2020, IEEE/ACM Transactions on Networking.

[4]  Ivan Poupyrev,et al.  Interacting with Soli: Exploring Fine-Grained Dynamic Gesture Recognition in the Radio-Frequency Spectrum , 2016, UIST.

[5]  Rob Miller,et al.  3D Tracking via Body Radio Reflections , 2014, NSDI.

[6]  Navrati Saxena,et al.  Directional Discontinuous Reception (DDRX) for mmWave Enabled 5G Communications , 2019, IEEE Transactions on Mobile Computing.

[7]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Dimitrios Koutsonikolas,et al.  Multi-Stream Beam-Training for mmWave MIMO Networks , 2018, MobiCom.

[9]  Jonathan Krause,et al.  Fine-grained recognition without part annotations , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Carlo Fischione,et al.  Guest Editorial Millimeter-Wave Networking , 2019, IEEE J. Sel. Areas Commun..

[11]  Jian Liu,et al.  Demo: Hands-Free Human Activity Recognition Using Millimeter-Wave Sensors , 2019, 2019 IEEE International Symposium on Dynamic Spectrum Access Networks (DySPAN).

[12]  An Liu,et al.  Successive Localization and Beamforming in 5G mmWave MIMO Communication Systems , 2019, IEEE Transactions on Signal Processing.

[13]  B. Langen,et al.  Reflection and transmission behaviour of building materials at 60 GHz , 1994, 5th IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, Wireless Networks - Catching the Mobile Future..

[14]  Swarun Kumar,et al.  On the Feasibility of Wi-Fi Based Material Sensing , 2019, MobiCom.

[15]  David Erickson,et al.  Nutrilyzer: A Mobile System for Characterizing Liquid Food with Photoacoustic Effect , 2016, SenSys.

[16]  J. Wyman THE DIELECTRIC CONSTANT OF MIXTURES OF ETHYL ALCOHOL AND WATER FROM -5 TO 40° , 1931 .

[17]  Liang Liu,et al.  Understanding Operational 5G: A First Measurement Study on Its Coverage, Performance and Energy Consumption , 2020, SIGCOMM.

[18]  K. J. Ray Liu,et al.  ViMo: Vital Sign Monitoring Using Commodity Millimeter Wave Radio , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  Mani Srivastava,et al.  RadHAR: Human Activity Recognition from Point Clouds Generated through a Millimeter-wave Radar , 2019, mmNets@MobiCom.

[20]  Wei Wang,et al.  Real-time Arm Gesture Recognition in Smart Home Scenarios via Millimeter Wave Sensing , 2020, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[21]  Unsoo Ha,et al.  Food and Liquid Sensing in Practical Environments using RFIDs , 2020, NSDI.

[22]  Tanya M. Monro,et al.  Identification and Quantification of Explosives in Nanolitre Solution Volumes by Raman Spectroscopy in Suspended Core Optical Fibers , 2013, Sensors.

[23]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[24]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Avik Santra,et al.  One-Shot Learning for Robust Material Classification Using Millimeter-Wave Radar System , 2018, IEEE Sensors Letters.

[26]  Ben Y. Zhao,et al.  Reusing 60GHz Radios for Mobile Radar Imaging , 2015, MobiCom.

[27]  Peter Nussbaum,et al.  Unsupervised Clustering of Hyperspectral Paper Data Using t-SNE , 2020, J. Imaging.

[28]  Patrick Schrempf,et al.  RadarCat: Radar Categorization for Input & Interaction , 2016, UIST.

[29]  N. Wang,et al.  Chapter 7 – Spoilage of Milk and Dairy Products , 2017 .

[30]  D. Thomson,et al.  A wireless passive pH sensor for real-time in vivo milk quality monitoring , 2012, 2012 IEEE Sensors.

[31]  Shaoyuan Yang,et al.  Autonomous Environment Mapping Using Commodity Millimeter-wave Network Device , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[32]  Ju Wang,et al.  TagScan: Simultaneous Target Imaging and Material Identification with Commodity RFID Devices , 2017, MobiCom.

[33]  Qi Yang,et al.  Millimeter-Wave Array Radar-Based Human Gait Recognition Using Multi-Channel Three-Dimensional Convolutional Neural Network , 2020, Sensors.

[34]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Xiaojiang Chen,et al.  Tagtag: material sensing with commodity RFID , 2019, SenSys.

[36]  G. Bridges,et al.  Wireless Passive Sensors for Food Quality Monitoring: Improving the Safety of Food Products , 2020, IEEE Antennas and Propagation Magazine.

[37]  Dina Katabi,et al.  Liquid Testing with Your Smartphone , 2019, MobiSys.

[38]  M. Schöning,et al.  Rapid methods and sensors for milk quality monitoring and spoilage detection. , 2019, Biosensors & bioelectronics.

[39]  Parth H. Pathak,et al.  Monitoring vital signs using millimeter wave , 2016, MobiHoc.

[40]  Andrew Markham,et al.  See through smoke: robust indoor mapping with low-cost mmWave radar , 2020, MobiSys.

[41]  Song Wang,et al.  Robot Navigation in Radio Beam Space: Leveraging Robotic Intelligence for Seamless mmWave Network Coverage , 2019, MobiHoc.

[42]  Artur Zdunek,et al.  Sensing the Structural Differences in Cellulose from Apple and Bacterial Cell Wall Materials by Raman and FT-IR Spectroscopy , 2011, Sensors.

[43]  Takumi Kobayashi,et al.  Large Margin In Softmax Cross-Entropy Loss , 2019, BMVC.

[44]  Xinyu Zhang,et al.  Following the Shadow: Agile 3-D Beam-Steering for 60 GHz Wireless Networks , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[45]  Yuanzhi Li,et al.  Convergence Analysis of Two-layer Neural Networks with ReLU Activation , 2017, NIPS.

[46]  Ben Y. Zhao,et al.  60GHz Mobile Imaging Radar , 2015, HotMobile.

[47]  Dan Wu,et al.  Toward Centimeter-Scale Human Activity Sensing with Wi-Fi Signals , 2017, Computer.

[48]  Romit Roy Choudhury,et al.  LiquID: A Wireless Liquid IDentifier , 2018, MobiSys.

[49]  F. Zaman,et al.  Isopropyl alcohol intoxication: a diagnostic challenge. , 2002, American journal of kidney diseases : the official journal of the National Kidney Foundation.

[50]  Parth H. Pathak,et al.  Poster Abstract: Human Tracking and Activity Monitoring Using 60 GHz mmWave , 2016, 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[51]  Wenzheng Bao,et al.  An Approach of Spectra Standardization and Qualitative Identification for Biomedical Materials Based on Terahertz Spectroscopy , 2020, Sci. Program..

[52]  Parth H. Pathak,et al.  Vital Sign and Sleep Monitoring Using Millimeter Wave , 2017, ACM Trans. Sens. Networks.

[53]  Shilin Zhu,et al.  Gait Recognition for Co-Existing Multiple People Using Millimeter Wave Sensing , 2020, AAAI.

[54]  L. H. King,et al.  Hemodialysis for isopropyl alcohol poisoning. , 1970, JAMA.

[55]  Dingyi Fang,et al.  WiMi: Target Material Identification with Commodity Wi-Fi Devices , 2019, 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS).

[56]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[57]  Tao Mei,et al.  Look Closer to See Better: Recurrent Attention Convolutional Neural Network for Fine-Grained Image Recognition , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[58]  Wei Zeng,et al.  Exploiting Multi-grain Ranking Constraints for Precisely Searching Visually-similar Vehicles , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).