On Algorithmic Decision Procedures in Emergency Response Systems in Smart and Connected Communities

Emergency Response Management (ERM) is a critical problem faced by communities across the globe. Despite this, it is common for ERM systems to follow myopic decision policies in the real world. Principled approaches to aid ERM decision-making under uncertainty have been explored but have failed to be accepted into real systems. We identify a key issue impeding their adoption --- algorithmic approaches to emergency response focus on reactive, post-incident dispatching actions, i.e. optimally dispatching a responder \textit{after} incidents occur. However, the critical nature of emergency response dictates that when an incident occurs, first responders always dispatch the closest available responder to the incident. We argue that the crucial period of planning for ERM systems is not post-incident, but between incidents. This is not a trivial planning problem --- a major challenge with dynamically balancing the spatial distribution of responders is the complexity of the problem. An orthogonal problem in ERM systems is planning under limited communication, which is particularly important in disaster scenarios that affect communication networks. We address both problems by proposing two partially decentralized multi-agent planning algorithms that utilize heuristics and exploit the structure of the dispatch problem. We evaluate our proposed approach using real-world data, and find that in several contexts, dynamic re-balancing the spatial distribution of emergency responders reduces both the average response time as well as its variance.

[1]  Sridhar Mahadevan,et al.  Learning to Cooperate using Hierarchical Reinforcement Learning , 2006 .

[2]  Y. Shoham Proceedings of the 6th conference on Theoretical aspects of rationality and knowledge , 1996 .

[3]  Milind Tambe,et al.  Optimal Allocation of Police Patrol Resources Using a Continuous-Time Crime Model , 2016, GameSec.

[4]  Peter Auer,et al.  Finite-time Analysis of the Multiarmed Bandit Problem , 2002, Machine Learning.

[5]  Csaba Szepesvári,et al.  Bandit Based Monte-Carlo Planning , 2006, ECML.

[6]  Frans A. Oliehoek,et al.  Decentralised Online Planning for Multi-Robot Warehouse Commissioning , 2017, AAMAS.

[7]  S. Dean Why the Closest Ambulance Cannot be Dispatched in an Urban Emergency Medical Services System , 2008, Prehospital and Disaster Medicine.

[8]  Sridhar Mahadevan,et al.  Learning to Take Concurrent Actions , 2002, NIPS.

[9]  Yevgeniy Vorobeychik,et al.  An online decision-theoretic pipeline for responder dispatch , 2019, ICCPS.

[10]  Natarajan Gautam,et al.  Analysis of Queues: Methods and Applications , 2017 .

[11]  Sean K Keneally,et al.  A markov decision process model for the optimal dispatch of military medical evacuation assets , 2016, Health care management science.

[12]  M. Pagano,et al.  Survival analysis. , 1996, Nutrition.

[13]  Yevgeniy Vorobeychik,et al.  A Decision Theoretic Framework for Emergency Responder Dispatch , 2018, AAMAS.

[14]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[15]  Ramayya Krishnan,et al.  An Efficient Simulation-Based Approach to Ambulance Fleet Allocation and Dynamic Redeployment , 2012, AAAI.

[16]  Gautam Biswas,et al.  Incident analysis and prediction using clustering and Bayesian network , 2017, 2017 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computed, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI).

[17]  Gautam Biswas,et al.  Structured Summarization of Social Web for Smart Emergency Services by Uncertain Concept Graph , 2018, 2018 IEEE International Science of Smart City Operations and Platforms Engineering in Partnership with Global City Teams Challenge (SCOPE-GCTC).

[18]  Gautam Biswas,et al.  Prioritized Allocation of Emergency Responders based on a Continuous-Time Incident Prediction Model , 2017, AAMAS.

[19]  Craig Boutilier,et al.  Planning, Learning and Coordination in Multiagent Decision Processes , 1996, TARK.