Feasibility of Discriminating UAV Propellers Noise from Distress Signals to Locate People in Enclosed Environments Using MEMS Microphone Arrays

Detecting and finding people are complex tasks when visibility is reduced. This happens, for example, if a fire occurs. In these situations, heat sources and large amounts of smoke are generated. Under these circumstances, locating survivors using thermal or conventional cameras is not possible and it is necessary to use alternative techniques. The challenge of this work was to analyze if it is feasible the integration of an acoustic camera, developed at the University of Valladolid, on an unmanned aerial vehicle (UAV) to locate, by sound, people who are calling for help, in enclosed environments with reduced visibility. The acoustic array, based on MEMS (micro-electro-mechanical system) microphones, locates acoustic sources in space, and the UAV navigates autonomously by closed enclosures. This paper presents the first experimental results locating the angles of arrival of multiple sound sources, including the cries for help of a person, in an enclosed environment. The results are promising, as the system proves able to discriminate the noise generated by the propellers of the UAV, at the same time it identifies the angles of arrival of the direct sound signal and its first echoes reflected on the reflective surfaces.

[1]  Silvio Savarese,et al.  Detecting and tracking people using an RGB-D camera via multiple detector fusion , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[2]  Wouter Olthuis,et al.  A review of silicon microphones , 1994 .

[3]  ZhangYu,et al.  Robust Autonomous Flight in Constrained and Visually Degraded Shipboard Environments , 2017 .

[4]  Wolfram Burgard,et al.  Mapping and localization with RFID technology , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[5]  Luis Miguel Bergasa,et al.  A Multi-Sensorial Simultaneous Localization and Mapping (SLAM) System for Low-Cost Micro Aerial Vehicles in GPS-Denied Environments , 2017, Sensors.

[6]  Rudolf Mathar,et al.  Location tracking of mobiles in cellular radio networks , 1999 .

[7]  An Braeken,et al.  Design Exploration and Performance Strategies towards Power-Efficient FPGA-Based Architectures for Sound Source Localization , 2019, J. Sensors.

[8]  Stefano Chessa,et al.  Indoor Bluetooth Low Energy Dataset for Localization, Tracking, Occupancy, and Social Interaction , 2018, Sensors.

[9]  Jung-Tang Huang,et al.  City Marathon Active Timing System Using Bluetooth Low Energy Technology , 2019 .

[10]  Pi Sheng Chang,et al.  Acoustic source location using a microphone array , 2003 .

[11]  Damanjit Singh,et al.  A real time GSM/GPS based tracking system based on GSM mobile phone , 2013, Second International Conference on Future Generation Communication Technologies (FGCT 2013).

[12]  Jianping Li,et al.  Calibrate Multiple Consumer RGB-D Cameras for Low-Cost and Efficient 3D Indoor Mapping , 2018, Remote. Sens..

[13]  Mark Johnson,et al.  TDOA-based passive localization of standard WiFi devices , 2018, 2018 Ubiquitous Positioning, Indoor Navigation and Location-Based Services (UPINLBS).

[14]  Martin Vetterli,et al.  Euclidean Distance Matrices: Essential theory, algorithms, and applications , 2015, IEEE Signal Processing Magazine.

[15]  P. Rudol,et al.  Human Body Detection and Geolocalization for UAV Search and Rescue Missions Using Color and Thermal Imagery , 2008, 2008 IEEE Aerospace Conference.

[16]  Yuwei Chen,et al.  The Accuracy Comparison of Three Simultaneous Localization and Mapping (SLAM)-Based Indoor Mapping Technologies † , 2018, Sensors.

[17]  James D. Taylor Ultra-wideband Radar Technology , 2000 .

[18]  Lara del Val Puente,et al.  Design and Evaluation of a Scalable and Reconfigurable Multi-Platform System for Acoustic Imaging , 2016, Sensors.

[19]  M. Werner,et al.  A Novel Hybrid Algorithm for Passive Localization of Victims in Emergency Situations , 2011, 2008 4th Advanced Satellite Mobile Systems.

[20]  S. Beeby,et al.  MEMS Mechanical Sensors , 2004 .

[21]  B.D. Rigling,et al.  Low-Cost Acoustic Array for Small UAV Detection and Tracking , 2008, 2008 IEEE National Aerospace and Electronics Conference.

[22]  Youngwook Kim,et al.  Human Detection Using Doppler Radar Based on Physical Characteristics of Targets , 2015, IEEE Geoscience and Remote Sensing Letters.

[23]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Jian Mi,et al.  Design of an HF-Band RFID System with Multiple Readers and Passive Tags for Indoor Mobile Robot Self-Localization , 2016, Sensors.

[25]  Liang Liu,et al.  Indoor Positioning Based on Bluetooth Low-Energy Beacons Adopting Graph Optimization , 2018, Sensors.

[26]  Peter Wellig,et al.  Detection and tracking of drones using advanced acoustic cameras , 2015, SPIE Security + Defence.

[27]  Jian Tang,et al.  2D LiDAR SLAM Back-End Optimization with Control Network Constraint for Mobile Mapping , 2018, Sensors.

[28]  Yu Zhang,et al.  Robust Autonomous Flight in Constrained and Visually Degraded Shipboard Environments , 2017, J. Field Robotics.

[29]  B.D. Van Veen,et al.  Beamforming: a versatile approach to spatial filtering , 1988, IEEE ASSP Magazine.

[30]  Feng Xia,et al.  Localization Technologies for Indoor Human Tracking , 2010, 2010 5th International Conference on Future Information Technology.

[31]  Arun Ross,et al.  Microphone Arrays , 2009, Encyclopedia of Biometrics.

[32]  Trung-Kien Le,et al.  Rank Properties for Matrices Constructed From Time Differences of Arrival , 2018, IEEE Transactions on Signal Processing.

[33]  Jeroen van Schaick,et al.  Sensing Human Activity: GPS Tracking , 2009, Sensors.

[34]  Harry L. Van Trees,et al.  Optimum Array Processing: Part IV of Detection, Estimation, and Modulation Theory , 2002 .

[35]  Dharma P. Agrawal,et al.  GPS: Location-Tracking Technology , 2002, Computer.

[36]  Modesto Castrillón Santana,et al.  On the Use of a Low-Cost Thermal Sensor to Improve Kinect People Detection in a Mobile Robot , 2013, Sensors.

[37]  Qi Chen,et al.  LiDAR Remote Sensing and Applications , 2017 .