Sensor fusion: A review of methods and applications

This paper aims to present a brief overview of the development of sensor fusion in various application in recent years, and to understand the challenges and ability of sensor fusion. Various algorithms that are typically employed are covered to comprehend the complexity of usage in different scenarios.

[1]  Christian Bonnet,et al.  Integrating connected vehicles in Internet of Things ecosystems: Challenges and solutions , 2016, 2016 IEEE 17th International Symposium on A World of Wireless, Mobile and Multimedia Networks (WoWMoM).

[2]  Ren C. Luo,et al.  A tutorial on multisensor integration and fusion , 1990, [Proceedings] IECON '90: 16th Annual Conference of IEEE Industrial Electronics Society.

[3]  Arkady B. Zaslavsky,et al.  Sensing as a Service and Big Data , 2013, ArXiv.

[4]  Ehsan Valavi,et al.  Microsoft Word-Final.docx , 2010 .

[5]  Hugh F. Durrant-Whyte,et al.  Multisensor Data Fusion , 2016, Springer Handbook of Robotics, 2nd Ed..

[6]  K. Goebel,et al.  Hybrid Data Fusion for Correction of Sensor Drift Faults , 2006, The Proceedings of the Multiconference on "Computational Engineering in Systems Applications".

[7]  Philippe Bonnifait,et al.  Data fusion of four ABS sensors and GPS for an enhanced localization of car-like vehicles , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[8]  Thierry Denoeux,et al.  A neural network classifier based on Dempster-Shafer theory , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[9]  Dong Jiang,et al.  An artificial neural network model for estimating crop yields using remotely sensed information , 2004 .

[10]  Denis Gillet,et al.  Reciprocal collision avoidance for quadrotors using on-board visual detection , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  Arnaud Doucet,et al.  A survey of convergence results on particle filtering methods for practitioners , 2002, IEEE Trans. Signal Process..

[12]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[13]  Shaojie Shen,et al.  Aggressive quadrotor flight using dense visual-inertial fusion , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Ho-Sub Yoon,et al.  Automated Speaker Recognition for Home Service Robots Using Genetic Algorithm and Dempster–Shafer Fusion Technique , 2009, IEEE Transactions on Instrumentation and Measurement.

[15]  Ramez Elmasri,et al.  Issues in data fusion for healthcare monitoring , 2008, PETRA '08.

[16]  Lorenzo Sabattini,et al.  Cloud robotics paradigm for enhanced navigation of autonomous vehicles in real world industrial applications , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[17]  K. Aminian,et al.  Quaternion-based fusion of gyroscopes and accelerometers to improve 3D angle measurement , 2006 .

[18]  Housheng Su,et al.  Distributed estimation and control for two-target tracking mobile sensor networks , 2017, J. Frankl. Inst..

[19]  Xiaojuan Wei.  Autonomous control system for the quadrotor unmanned aerial vehicle , 2016, 2016 13th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[20]  Martin Vossiek,et al.  Precise local-positioning for autonomous situation awareness in the Internet of Things , 2014, 2014 IEEE MTT-S International Microwave Symposium (IMS2014).

[21]  Jeffrey K. Uhlmann,et al.  Covariance consistency methods for fault-tolerant distributed data fusion , 2003, Inf. Fusion.

[22]  Mau-Tsuen Yang,et al.  Appearance-Based Multimodal Human Tracking and Identification for Healthcare in the Digital Home , 2014, Sensors.

[23]  Rüdiger Dillmann,et al.  Sensor fusion for 3D human body tracking with an articulated 3D body model , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[24]  Chun C. Lai,et al.  Multisensor Fusion and Integration: Theories, Applications, and its Perspectives , 2011, IEEE Sensors Journal.

[25]  Hugh F. Durrant-Whyte,et al.  A new method for the nonlinear transformation of means and covariances in filters and estimators , 2000, IEEE Trans. Autom. Control..

[26]  Dieter Fox,et al.  Bayesian Filtering for Location Estimation , 2003, IEEE Pervasive Comput..

[27]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[28]  Li-Chen Fu,et al.  Unsupervised context discovery based on hierarchical fusion of heterogeneous features in real smart living environments , 2016, 2016 IEEE International Conference on Automation Science and Engineering (CASE).

[29]  Jie Liu,et al.  Distributed state representation for tracking problems in sensor networks , 2004, IPSN '04.

[30]  Patrick Rives,et al.  Dense accurate urban mapping from spherical RGB-D images , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[31]  P. J. Escamilla-Ambrosio,et al.  Hybrid Kalman filter-fuzzy logic adaptive multisensor data fusion architectures , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[32]  Rafael Canetti,et al.  Design and implementation of sensor data fusion for an autonomous quadrotor , 2014, 2014 IEEE International Instrumentation and Measurement Technology Conference (I2MTC) Proceedings.

[33]  Antonios Tsourdos,et al.  Sensor based robot localisation and navigation: using interval analysis and unscented Kalman filter , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[34]  Arthur C. Sanderson,et al.  Multisensor Fusion - A Minimal Representation Framework , 1999, Series in Intelligent Control and Intelligent Automation.

[35]  Wolfram Burgard,et al.  Multimodal deep learning for robust RGB-D object recognition , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[36]  Dafang Zhuang,et al.  Advances in Multi-Sensor Data Fusion: Algorithms and Applications , 2009, Sensors.

[37]  Michael Müller,et al.  IoT-based dynamic street light control for smart cities use cases , 2016, 2016 International Symposium on Networks, Computers and Communications (ISNCC).

[38]  Iwan Ulrich,et al.  VFH/sup */: local obstacle avoidance with look-ahead verification , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[39]  Lei Wang,et al.  Distributed estimation and control for mobile sensor networks with coupling delays. , 2016, ISA transactions.

[40]  Ren C. Luo,et al.  Multisensor Fusion and Integration: A Review on Approaches and Its Applications in Mechatronics , 2012, IEEE Transactions on Industrial Informatics.

[41]  A. Yilmaz.  Sensor Fusion in Computer Vision , 2007, 2007 Urban Remote Sensing Joint Event.

[42]  Mubarak Shah,et al.  Multi-sensor fusion: a perspective , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[43]  Richard M. Murray,et al.  Approximate distributed Kalman filtering in sensor networks with quantifiable performance , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[44]  Yoshihiko Kimuro,et al.  A vision system for detecting mobile robots in office environments , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[45]  Hu Guanshan.  Neural Network Applications in Sensor Fusion for a Mobile Robot Motion , 2010, 2010 WASE International Conference on Information Engineering.

[46]  Federico Castanedo,et al.  A Review of Data Fusion Techniques , 2013, TheScientificWorldJournal.

[47]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[48]  Jeffrey A. Barnett,et al.  Computational Methods for a Mathematical Theory of Evidence , 1981, IJCAI.

[49]  Arthur P. Dempster,et al.  A Generalization of Bayesian Inference , 1968, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[50]  J. A. Stover,et al.  An autonomous fuzzy logic architecture for multisensor data fusion , 1994, Proceedings of 1994 IEEE International Conference on MFI '94. Multisensor Fusion and Integration for Intelligent Systems.

[51]  Mobyen Uddin Ahmed,et al.  Physiological Sensor Signals Classification for Healthcare Using Sensor Data Fusion and Case-Based Reasoning , 2014, Sensors.

[52]  Bernadette Dorizzi,et al.  A pervasive multi-sensor data fusion for smart home healthcare monitoring , 2011, 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011).

[53]  Demoz Gebre-Egziabher,et al.  Calibration of Strapdown Magnetometers in Magnetic Field Domain , 2006 .

[54]  Fakhri Karray,et al.  Multisensor data fusion: A review of the state-of-the-art , 2013, Inf. Fusion.

[55]  Prakash P. Shenoy,et al.  A Comparison of Bayesian and Belief Function Reasoning , 2003, Inf. Syst. Frontiers.

[56]  Jeffrey K. Uhlmann,et al.  A non-divergent estimation algorithm in the presence of unknown correlations , 1997, Proceedings of the 1997 American Control Conference (Cat. No.97CH36041).

[57]  Gregory M. Provan,et al.  The validity of Dempster-Shafer belief functions , 1992, Int. J. Approx. Reason..

[58]  Heesung Kwon,et al.  Human-autonomy sensor fusion for rapid object detection , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[59]  R. L. Kashyap,et al.  Comparison of Bayesian and Dempster’s Rules in Evidence Combination , 1988 .

[60]  Jon Atli Benediktsson,et al.  Fusion of Support Vector Machines for Classification of Multisensor Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[61]  Imran Shafi,et al.  An architecture to analyze big data in the Internet of Things , 2015, 2015 9th International Conference on Sensing Technology (ICST).

[62]  P. Jayasankar,et al.  Cloud-Assisted Data Fusion and Sensor Selection for Internet-of-Things , 2016 .

[63]  Huosheng Hu,et al.  SVM Based SLAM Algorithm for Autonomous Mobile Robots , 2007, 2007 International Conference on Mechatronics and Automation.

[64]  Ekta M. Upadhyay,et al.  Exposure fusion for concealed weapon detection , 2014, 2014 2nd International Conference on Devices, Circuits and Systems (ICDCS).

[65]  Amy Loutfi,et al.  Challenges and Issues in Multisensor Fusion Approach for Fall Detection: Review Paper , 2016, J. Sensors.

[66]  Marko Munih,et al.  Using sensory data fusion methods for infant body posture assessment , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[67]  Marimuthu Palaniswami,et al.  Distributed data fusion using support vector machines , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[68]  B. R. Bracio,et al.  Sensor fusion in biomedical systems , 1997, Proceedings of the 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 'Magnificent Milestones and Emerging Opportunities in Medical Engineering' (Cat. No.97CH36136).

[69]  Su-Lim Tan,et al.  Sensor data fusion for attitude stabilization in a low cost Quadrotor system , 2011, 2011 IEEE 15th International Symposium on Consumer Electronics (ISCE).

[70]  Samuel S. Blackman,et al.  Theoretical Approaches To Data Association And Fusion , 1988, Defense, Security, and Sensing.

[71]  Dhananjay Singh,et al.  A survey of Internet-of-Things: Future vision, architecture, challenges and services , 2014, 2014 IEEE World Forum on Internet of Things (WF-IoT).

[72]  Sameer Singh,et al.  Approaches to Multisensor Data Fusion in Target Tracking: A Survey , 2006, IEEE Transactions on Knowledge and Data Engineering.

[73]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[74]  Hyun-il Kwon,et al.  Sensor data fusion using Unscented Kalman Filter for accurate localization of mobile robots , 2010, ICCAS 2010.

[75]  Alaa M. Khamis,et al.  Bayesian approach to multisensor data fusion with Pre- and Post-Filtering , 2013, 2013 10th IEEE INTERNATIONAL CONFERENCE ON NETWORKING, SENSING AND CONTROL (ICNSC).

[76]  Ismail Güvenç,et al.  IoT-based occupancy monitoring techniques for energy-efficient smart buildings , 2015, 2015 IEEE Wireless Communications and Networking Conference Workshops (WCNCW).

[77]  Anh-Tuan Do,et al.  Internet of Things: Trends, challenges and applications , 2014, 2014 International Symposium on Integrated Circuits (ISIC).

[78]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[79]  Heinrich H. Bülthoff,et al.  Autonomous vegetation identification for outdoor aerial navigation , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[80]  Wei Zheng,et al.  Multi-sensor fusion based real-time hovering for a quadrotor without GPS in assigned position , 2016, 2016 Chinese Control and Decision Conference (CCDC).

[81]  Henry Leung,et al.  Neural data fusion algorithms based on a linearly constrained least square method , 2002, IEEE Trans. Neural Networks.