GIobalFusion: A Global Attentional Deep Learning Framework for Multisensor Information Fusion

SHENGZHONG LIU*, University of Illinois at Urbana-Champaign SHUOCHAO YAO*, University of Illinois at Urbana-Champaign JINYANG LI, University of Illinois at Urbana-Champaign DONGXIN LIU, University of Illinois at Urbana-Champaign TIANSHI WANG, University of Illinois at Urbana-Champaign HUAJIE SHAO, University of Illinois at Urbana-Champaign TAREK ABDELZAHER, University of Illinois at Urbana-Champaign

[1]  Shuicheng Yan,et al.  A2-Nets: Double Attention Networks , 2018, NeurIPS.

[2]  Nicholas D. Lane,et al.  Squeezing Deep Learning into Mobile and Embedded Devices , 2017, IEEE Pervasive Computing.

[3]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[4]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[5]  Nicholas D. Lane,et al.  Sparsification and Separation of Deep Learning Layers for Constrained Resource Inference on Wearables , 2016, SenSys.

[6]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[7]  Shaohan Hu,et al.  Deep Learning for the Internet of Things , 2018, Computer.

[8]  Frédéric Jurie,et al.  Multilevel Sensor Fusion With Deep Learning , 2018, IEEE Sensors Letters.

[9]  Hassan Ghasemzadeh,et al.  Synchronous Dynamic View Learning: A Framework for Autonomous Training of Activity Recognition Models Using Wearable Sensors , 2017, 2017 16th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[10]  James Llinas,et al.  Handbook of Multisensor Data Fusion , 2001 .

[11]  Nadia Bianchi-Berthouze,et al.  Learning Temporal and Bodily Attention in Protective Movement Behavior Detection , 2019, 2019 8th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW).

[12]  Billur Barshan,et al.  Comparative study on classifying human activities with miniature inertial and magnetic sensors , 2010, Pattern Recognit..

[13]  Jasper Snoek,et al.  Spectral Representations for Convolutional Neural Networks , 2015, NIPS.

[14]  Yoshua Bengio,et al.  Show, Attend and Tell: Neural Image Caption Generation with Visual Attention , 2015, ICML.

[15]  Timo Sztyler,et al.  On-body localization of wearable devices: An investigation of position-aware activity recognition , 2016, 2016 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[16]  Mahesh K. Marina,et al.  Towards multimodal deep learning for activity recognition on mobile devices , 2016, UbiComp Adjunct.

[17]  Wenyu Zhang,et al.  Deep fusion of heterogeneous sensor data , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[18]  Christopher D. Manning,et al.  Effective Approaches to Attention-based Neural Machine Translation , 2015, EMNLP.

[19]  Ming Zeng,et al.  Understanding and improving recurrent networks for human activity recognition by continuous attention , 2018, UbiComp.

[20]  Chenglin Miao,et al.  DeepFusion: A Deep Learning Framework for the Fusion of Heterogeneous Sensory Data , 2019, MobiHoc.

[21]  Xiangyu Wang,et al.  RF Sensing in the Internet of Things: A General Deep Learning Framework , 2018, IEEE Communications Magazine.

[22]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Christian Wolf,et al.  ModDrop: Adaptive Multi-Modal Gesture Recognition , 2014, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Tarek F. Abdelzaher,et al.  DeepIoT: Compressing Deep Neural Network Structures for Sensing Systems with a Compressor-Critic Framework , 2017, SenSys.

[25]  Shaohan Hu,et al.  DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processing , 2016, WWW.

[26]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[27]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[28]  Nicholas D. Lane,et al.  DeepX: A Software Accelerator for Low-Power Deep Learning Inference on Mobile Devices , 2016, 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[29]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[31]  Min Peng,et al.  Learning Bodily and Temporal Attention in Protective Movement Behavior Detection , 2019, ArXiv.

[32]  He Wang,et al.  I am a Smartwatch and I can Track my User's Arm , 2016, MobiSys.

[33]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[34]  Pramod K. Varshney,et al.  Multisensor Data Fusion , 1997, IEA/AIE.

[35]  Shuochao Yao,et al.  GreenRoute: A Generalizable Fuel-Saving Vehicular Navigation Service , 2019, 2019 IEEE International Conference on Autonomic Computing (ICAC).

[36]  Abhinav Gupta,et al.  Non-local Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[37]  Jiawei Han,et al.  STFNets: Learning Sensing Signals from the Time-Frequency Perspective with Short-Time Fourier Neural Networks , 2019, WWW.

[38]  Philip H. S. Torr,et al.  Learn To Pay Attention , 2018, ICLR.

[39]  Neil W. Bergmann,et al.  Sensor-Assisted Face Recognition System on Smart Glass via Multi-View Sparse Representation Classification , 2016, 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[40]  Kebin Jia,et al.  A Multi-view Deep Learning Method for Epileptic Seizure Detection using Short-time Fourier Transform , 2017, BCB.

[41]  B. S. Manjunath,et al.  Caesar: cross-camera complex activity recognition , 2019, SenSys.

[42]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[43]  Shaohan Hu,et al.  SADeepSense: Self-Attention Deep Learning Framework for Heterogeneous On-Device Sensors in Internet of Things Applications , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[44]  VALENTIN RADU,et al.  Multimodal Deep Learning for Activity and Context Recognition , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[45]  Kaishun Wu,et al.  Real-time Arm Skeleton Tracking and Gesture Inference Tolerant to Missing Wearable Sensors , 2019, MobiSys.

[46]  Rohan Ramanath,et al.  An Attentive Survey of Attention Models , 2019, ACM Trans. Intell. Syst. Technol..

[47]  Didier Stricker,et al.  Introducing a New Benchmarked Dataset for Activity Monitoring , 2012, 2012 16th International Symposium on Wearable Computers.

[48]  Jeffrey M. Hausdorff,et al.  Potentials of Enhanced Context Awareness in Wearable Assistants for Parkinson's Disease Patients with the Freezing of Gait Syndrome , 2009, 2009 International Symposium on Wearable Computers.