Localization Services for Online Common Operational Picture and Situation Awareness

Many operations, be they military, police, rescue, or other field operations, require localization services and online situation awareness to make them effective. Questions such as how many people are inside a building and their locations are essential. In this paper, an online localization and situation awareness system is presented, called Mobile Urban Situation Awareness System (MUSAS), for gathering and maintaining localization information, to form a common operational picture. The MUSAS provides multiple localization services, as well as visualization of other sensor data, in a common frame of reference. The information and common operational picture of the system is conveyed to all parties involved in the operation, the field team, and people in the command post. In this paper, a general system architecture for enabling localization based situation awareness is designed and the MUSAS system solution is presented. The developed subsystem components and forming of the common operational picture are summarized, and the future potential of the system for various scenarios is discussed. In the demonstration, the MUSAS is deployed to an unknown building, in an ad hoc fashion, to provide situation awareness in an urban indoor military operation.

[1]  Jari Saarinen,et al.  Best-first branch and bound search method for map based localization , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Ralph Kohler,et al.  Infrastructure, middleware, and applications for portable cellular devices in tactical edge networks , 2011, 2011 - MILCOM 2011 Military Communications Conference.

[3]  Frauke Driewer,et al.  Application of Soft Computing Techniques to Rescue Operation Planning , 2004, ICAISC.

[4]  Gang Zhou,et al.  VigilNet: An integrated sensor network system for energy-efficient surveillance , 2006, TOSN.

[5]  Shinsuke Hara,et al.  RSSI-based Localization without a Prior Knowledge of Channel Model Parameters , 2008, Int. J. Wirel. Inf. Networks.

[6]  Xi Chen,et al.  Sequential Monte Carlo for simultaneous passive device-free tracking and sensor localization using received signal strength measurements , 2011, Proceedings of the 10th ACM/IEEE International Conference on Information Processing in Sensor Networks.

[7]  M.G. Ceruti,et al.  Application of Wireless Sensor Network to Military Information Integration , 2007, 2007 5th IEEE International Conference on Industrial Informatics.

[8]  H. Hashemi,et al.  The indoor radio propagation channel , 1993, Proc. IEEE.

[9]  Neal Patwari,et al.  2008 International Conference on Information Processing in Sensor Networks Effects of Correlated Shadowing: Connectivity, Localization, and RF Tomography , 2022 .

[10]  Neal Patwari,et al.  A Fade-Level Skew-Laplace Signal Strength Model for Device-Free Localization with Wireless Networks , 2012, IEEE Transactions on Mobile Computing.

[11]  A. Amanatiadis,et al.  A fuzzy multi-sensor architecture for indoor navigation , 2010, 2010 IEEE International Conference on Imaging Systems and Techniques.

[12]  Jussi Suomela,et al.  GIMnet: infrastructure for distributed control of generic intelligent machines , 2007 .

[13]  H. Hashemi.  A study of temporal and spatial variations of the indoor radio propagation channel , 1994, 5th IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, Wireless Networks - Catching the Mobile Future..

[14]  Maurizio Bocca,et al.  Radio Tomographic Imaging for Ambient Assisted Living , 2012, EvAAL.

[15]  Neal Patwari,et al.  RF Sensor Networks for Device-Free Localization: Measurements, Models, and Algorithms , 2010, Proceedings of the IEEE.

[16]  Jae-Oh Lee,et al.  Enabling network management using Java technologies , 2000, IEEE Commun. Mag..

[17]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[18]  Maurizio Bocca,et al.  Follow @grandma: Long-term device-free localization for residential monitoring , 2012, 37th Annual IEEE Conference on Local Computer Networks - Workshops.

[19]  Yi Zheng,et al.  Through-wall tracking with radio tomography networks using foreground detection , 2012, 2012 IEEE Wireless Communications and Networking Conference (WCNC).

[20]  Hubert Roth,et al.  Mobile robots for search and rescue , 2005, IEEE International Safety, Security and Rescue Rototics, Workshop, 2005..

[21]  Deborah Estrin,et al.  Statistical model of lossy links in wireless sensor networks , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[22]  Henk Wymeersch,et al.  On the trade-off between accuracy and delay in cooperative UWB navigation , 2013, 2013 IEEE Wireless Communications and Networking Conference (WCNC).

[23]  Mikko Lindholm,et al.  Hybrid localization system for situation awareness applications , 2012 .

[24]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[25]  R. E. Balfour.  Next generation emergency management common operating picture software/systems (COPSS) , 2012, 2012 IEEE Long Island Systems, Applications and Technology Conference (LISAT).

[26]  Henk L. Muller,et al.  A 10mW Wearable Positioning System , 2006, 2006 10th IEEE International Symposium on Wearable Computers.

[27]  Mark Coates,et al.  Multi-target tracking for measurement models with additive contributions , 2011, 14th International Conference on Information Fusion.

[28]  Kazuya Yoshida,et al.  Collaborative mapping of an earthquake‐damaged building via ground and aerial robots , 2012, J. Field Robotics.

[29]  Bo Yang,et al.  Multi-target device-free tracking using radio frequency tomography , 2011, 2011 Seventh International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[30]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .

[31]  Michi Henning,et al.  A new approach to object-oriented middleware , 2004, IEEE Internet Computing.

[32]  Wei Zhou,et al.  DistressNet: a wireless ad hoc and sensor network architecture for situation management in disaster response , 2010, IEEE Communications Magazine.

[33]  Richard S. Hager,et al.  Current and Future Efforts to Vary the Level of Detail for the common Operational Picture , 1997 .

[34]  Suresh Venkatasubramanian,et al.  Multiple Target Tracking with RF Sensor Networks , 2013, IEEE Transactions on Mobile Computing.

[35]  Sunil Samtani,et al.  On the adaptation of commercial smartphones to tactical environments , 2011, 2011 - MILCOM 2011 Military Communications Conference.

[36]  Ossi Kaltiokallio,et al.  A management framework for device-free localization , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[37]  Alfred O. Hero,et al.  Relative location estimation in wireless sensor networks , 2003, IEEE Trans. Signal Process..

[38]  K. Woyach,et al.  Sensorless Sensing in Wireless Networks: Implementation and Measurements , 2006, 2006 4th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks.

[39]  Hans P. Moravec.  Sensor Fusion in Certainty Grids for Mobile Robots , 1988, AI Mag..

[40]  David E. Culler,et al.  Design of an application-cooperative management system for wireless sensor networks , 2005, Proceeedings of the Second European Workshop on Wireless Sensor Networks, 2005..

[41]  Jari Saarinen,et al.  GIMnet 2.0 - Enhanced Communication Framework for Distributed Control of Generic Intelligent Machines , 2012, CESCIT.

[42]  Fredrik Gustafsson,et al.  Localization in sensor networks based on log range observations , 2007, 2007 10th International Conference on Information Fusion.

[43]  Tomi Ylikorpi,et al.  A Novel Marsupial Robot Society: Towards Long-Term Autonomy , 2008, DARS.

[44]  Jari Saarinen,et al.  On the sensitivity of RSS based localization using the log-normal model: An empirical study , 2013, 2013 10th Workshop on Positioning, Navigation and Communication (WPNC).

[45]  Yang Zhao,et al.  Noise reduction for variance-based device-free localization and tracking , 2011, 2011 8th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks.

[46]  Reino Virrankoski.  Wireless sensor systems in indoor situation modeling II (WISM II) , 2013 .

[47]  Fernando Seco,et al.  A survey of mathematical methods for indoor localization , 2009, 2009 IEEE International Symposium on Intelligent Signal Processing.

[48]  Michael G. Rabbat,et al.  Background Subtraction for Online Calibration of Baseline RSS in RF Sensing Networks , 2012, IEEE Transactions on Mobile Computing.

[49]  Suresh Venkatasubramanian,et al.  Radio tomographic imaging and tracking of stationary and moving people via kernel distance , 2013, 2013 ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[50]  Jari Saarinen,et al.  Teleoperation Tests for Large-Scale Indoor Information Acquisition , 2012, CESCIT.

[51]  Naokazu Yokoya,et al.  A wearable augmented reality system for navigation using positioning infrastructures and a pedometer , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[52]  R. Dietterle.  The future combat systems (FCS) overview , 2005, MILCOM 2005 - 2005 IEEE Military Communications Conference.

[53]  Michael D. McNeese,et al.  Multiple Vantage Points of the Common Operational Picture: Supporting International Teamwork , 2006 .

[54]  L. J. Williams.  Small unit operations situation awareness system (SUO SAS): an overview , 2003, IEEE Military Communications Conference, 2003. MILCOM 2003..

[55]  Neal Patwari,et al.  See-Through Walls: Motion Tracking Using Variance-Based Radio Tomography Networks , 2011, IEEE Transactions on Mobile Computing.

[56]  Sverre Holm,et al.  Hybrid ultrasound-RFID indoor positioning: Combining the best of both worlds , 2009, 2009 IEEE International Conference on RFID.

[57]  Jari Saarinen,et al.  Simultaneous RSS-based Localization and Model Calibration in Wireless Networks With a Mobile Robot , 2012, ANT/MobiWIS.

[58]  J. Saarinen,et al.  Rescue personnel localization system , 2005, IEEE International Safety, Security and Rescue Rototics, Workshop, 2005..

[59]  Hugh F. Durrant-Whyte,et al.  A solution to the simultaneous localization and map building (SLAM) problem , 2001, IEEE Trans. Robotics Autom..

[60]  Neal Patwari,et al.  Radio Tomographic Imaging with Wireless Networks , 2010, IEEE Transactions on Mobile Computing.

[61]  S. Seidel,et al.  914 MHz path loss prediction models for indoor wireless communications in multifloored buildings , 1992 .

[62]  Hojung Cha,et al.  Inertial Sensor-Based Indoor Pedestrian Localization with Minimum 802.15.4a Configuration , 2011, IEEE Transactions on Industrial Informatics.

[63]  Alice Deschamps,et al.  Geospatial data integration for applications in flood prediction and management in the Red River Basin , 2002, IEEE International Geoscience and Remote Sensing Symposium.