Disaster City Digital Twin: A vision for integrating artificial and human intelligence for disaster management

Abstract This paper presents a vision for a Disaster City Digital Twin paradigm that can: (i) enable interdisciplinary convergence in the field of crisis informatics and information and communication technology (ICT) in disaster management; (ii) integrate artificial intelligence (AI) algorithms and approaches to improve situation assessment, decision making, and coordination among various stakeholders; and (iii) enable increased visibility into network dynamics of complex disaster management and humanitarian actions. The number of humanitarian relief actions is growing due to the increased frequency of natural and man-made crises. Various streams of research across different disciplines have focused on ICT and AI solutions for enhancing disaster management processes. However, most of the existing research is fragmented without a common vision towards a converging paradigm. Recognizing this, this paper presents the Disaster City Digital Twin as a unifying paradigm. The four main components of the proposed Digital Twin paradigm include: multi-data sensing for data collection, data integration and analytics, multi-actor game-theoretic decision making, and dynamic network analysis. For each component, the current state of the art related to AI methods and approaches are examined and gaps are identified.

[1]  Rudy Arthur,et al.  Social sensing of floods in the UK , 2017, PloS one.

[2]  Ferda Ofli,et al.  Combining Human Computing and Machine Learning to Make Sense of Big (Aerial) Data for Disaster Response , 2016, Big Data.

[3]  Amir Hossein Alavi,et al.  Machine learning in geosciences and remote sensing , 2016 .

[4]  Alexander L. Davis,et al.  Understanding Cumulative Risk Perception from Judgments and Choices: An Application to Flood Risks , 2018, Risk analysis : an official publication of the Society for Risk Analysis.

[5]  Theresa A. Pardo,et al.  Conceptualizing smart city with dimensions of technology, people, and institutions , 2011, dg.o '11.

[6]  Vidhyacharan Bhaskar,et al.  Big data analytics for disaster response and recovery through sentiment analysis , 2018, Int. J. Inf. Manag..

[7]  Liuqing Yang,et al.  Where does AlphaGo go: from church-turing thesis to AlphaGo thesis and beyond , 2016, IEEE/CAA Journal of Automatica Sinica.

[8]  Max Welling,et al.  Modeling Relational Data with Graph Convolutional Networks , 2017, ESWC.

[9]  M. Westoby,et al.  ‘Structure-from-Motion’ photogrammetry: A low-cost, effective tool for geoscience applications , 2012 .

[10]  Firoj Alam,et al.  Image4Act: Online Social Media Image Processing for Disaster Response , 2017, 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[11]  Honglak Lee,et al.  Multitask Reinforcement Learning for Zero-shot Generalization with Subtask Dependencies , 2018, NIPS 2018.

[12]  Wenlin Yao,et al.  Social media for intelligent public information and warning in disasters: An interdisciplinary review , 2019, Int. J. Inf. Manag..

[13]  Ali Mostafavi,et al.  Enhancing Resilience in Disaster Response: A Meta-Network Analysis Approach , 2018 .

[14]  Stefan Stieglitz,et al.  Social Media Analysis in Crisis Situations: Can Social Media be a Reliable Information Source for Emergency Management Services? , 2018, ISD.

[15]  Teh Ying Wah,et al.  Data fusion and multiple classifier systems for human activity detection and health monitoring: Review and open research directions , 2019, Inf. Fusion.

[16]  Nor Badrul Anuar,et al.  The role of big data in smart city , 2016, Int. J. Inf. Manag..

[17]  E. Bruce,et al.  A Review of Volunteered Geographic Information for Disaster Management , 2015 .

[18]  KhreichWael,et al.  A Survey of Techniques for Event Detection in Twitter , 2015, CI 2015.

[19]  Xiao Huang,et al.  Accelerated Attributed Network Embedding , 2017, SDM.

[20]  C. Castillo,et al.  Big Crisis Data: Social Media in Disasters and Time-Critical Situations , 2019 .

[21]  Sergey Levine,et al.  Near-Optimal Representation Learning for Hierarchical Reinforcement Learning , 2018, ICLR.

[22]  Muhammad Al-Amin Hoque,et al.  A systematic review of tropical cyclone disaster management research using remote sensing and spatial analysis , 2017 .

[23]  Lixin Tian,et al.  Resilience of networks with community structure behaves as if under an external field , 2018, Proceedings of the National Academy of Sciences.

[24]  Xiao Huang,et al.  Label Informed Attributed Network Embedding , 2017, WSDM.

[25]  Aditya G. Parameswaran,et al.  Accelerating Human-in-the-loop Machine Learning: Challenges and Opportunities , 2018, DEEM@SIGMOD.

[26]  Theocharis A. Plomaritis,et al.  Use of a Bayesian Network for coastal hazards, impact and disaster risk reduction assessment at a coastal barrier (Ria Formosa, Portugal) , 2017 .

[27]  Alexander Zipf,et al.  A geographic approach for combining social media and authoritative data towards identifying useful information for disaster management , 2015, Int. J. Geogr. Inf. Sci..

[28]  Wael Khreich,et al.  A Survey of Techniques for Event Detection in Twitter , 2015, Comput. Intell..

[29]  Bo Wang,et al.  Machine Learning based Digital Twin Framework for Production Optimization in Petrochemical Industry , 2019, Int. J. Inf. Manag..

[30]  Christopher Gomez,et al.  UAV- based Photogrammetry and Geocomputing for Hazards and Disaster Risk Monitoring – A Review , 2016, Geoenvironmental Disasters.

[31]  Cheng Zhang,et al.  A System Analytics Framework for Detecting Infrastructure-Related Topics in Disasters Using Social Sensing , 2018, EG-ICE.

[32]  Terje Gjøsæter,et al.  Universal Design of ICT for Emergency Management - A Systematic Literature Review and Research Agenda , 2018, HCI.

[33]  Christian Jutten,et al.  Multimodal Data Fusion: An Overview of Methods, Challenges, and Prospects , 2015, Proceedings of the IEEE.

[34]  Chao Fan,et al.  Metanetwork Framework for Performance Analysis of Disaster Management System-of-Systems , 2020, IEEE Systems Journal.

[35]  Zheng Zhang,et al.  MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems , 2015, ArXiv.

[36]  Sarah Vieweg,et al.  Processing Social Media Messages in Mass Emergency , 2014, ACM Comput. Surv..

[37]  Jure Leskovec,et al.  Hierarchical Graph Representation Learning with Differentiable Pooling , 2018, NeurIPS.

[38]  Rupak Goswami,et al.  Social networks in the context of community response to disaster: Study of a cyclone-affected community in Coastal West Bengal, India , 2017 .

[39]  A Min Tjoa,et al.  Availability, Reliability, and Security in Information Systems , 2016, Lecture Notes in Computer Science.

[40]  Heiko Paulheim,et al.  Knowledge graph refinement: A survey of approaches and evaluation methods , 2016, Semantic Web.

[41]  Stefan Stieglitz,et al.  Social media analytics - Challenges in topic discovery, data collection, and data preparation , 2018, Int. J. Inf. Manag..

[42]  Anna Corinna Cagliano,et al.  Current trends in Smart City initiatives: some stylised facts , 2014 .

[43]  Chase Qishi Wu,et al.  A Survey of Game Theory as Applied to Network Security , 2010, 2010 43rd Hawaii International Conference on System Sciences.

[44]  Simon Kingham,et al.  Deprived yet healthy: neighbourhood-level resilience in New Zealand. , 2013, Social science & medicine.

[45]  Manzhu Yu,et al.  Big Data in Natural Disaster Management: A Review , 2018 .

[46]  Shahriar Akter,et al.  Big data and disaster management: a systematic review and agenda for future research , 2017, Annals of Operations Research.

[47]  Chao Fan,et al.  Establishing a framework for disaster management system-of-systems , 2018, 2018 Annual IEEE International Systems Conference (SysCon).

[48]  Firoj Alam,et al.  Processing Social Media Images by Combining Human and Machine Computing during Crises , 2018, Int. J. Hum. Comput. Interact..

[49]  Yogesh Kumar Dwivedi,et al.  Artificial intelligence for decision making in the era of Big Data - evolution, challenges and research agenda , 2019, Int. J. Inf. Manag..

[50]  Stefanie Zollmann,et al.  Synchrony and Physiological Arousal Increase Cohesion and Cooperation in Large Naturalistic Groups , 2018, Scientific Reports.

[51]  Kathleen M. Carley,et al.  The Link Probability Model: A Network Simulation Alternative to the Exponential Random Graph Model , 2010 .

[52]  Hermann Hellwagner,et al.  Automatic Identification of Crisis-Related Sub-events Using Clustering , 2012, 2012 11th International Conference on Machine Learning and Applications.

[53]  Jaziar Radianti,et al.  Information Requirements for Disaster Victim Identification and Emergency Medical Services: Hajj Crowd Disaster Case Study , 2018, ISCRAM.

[54]  Narjès Bellamine Ben Saoud,et al.  Towards sustainable collaborative networks for smart cities co-governance , 2021, Int. J. Inf. Manag..

[55]  Ali Mostafavi,et al.  Social Sensing in Disaster City Digital Twin: Integrated Textual–Visual–Geo Framework for Situational Awareness during Built Environment Disruptions , 2020 .

[56]  Yogesh Kumar Dwivedi,et al.  Artificial Intelligence (AI): Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy , 2019, International Journal of Information Management.

[57]  Frederic Patricelli,et al.  Disaster Management: The Structure, Function, and Significance of Network-Centric Operations , 2008 .

[58]  Camelia-Mihaela Pintea,et al.  Towards interactive Machine Learning (iML): Applying Ant Colony Algorithms to Solve the Traveling Salesman Problem with the Human-in-the-Loop Approach , 2016, CD-ARES.

[59]  Cheng Zhang,et al.  Meta-Network Framework for Analyzing Disaster Management System-of-Systems , 2018, 2018 13th Annual Conference on System of Systems Engineering (SoSE).

[60]  Yang Shao,et al.  Detection of Urban Damage Using Remote Sensing and Machine Learning Algorithms: Revisiting the 2010 Haiti Earthquake , 2016, Remote. Sens..

[61]  Huan Wang,et al.  An event detection method for social networks based on link prediction , 2017, Inf. Syst..

[62]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[63]  Saeed Parsa,et al.  Task graph pre-scheduling, using Nash equilibrium in game theory , 2013, The Journal of Supercomputing.

[64]  Jocelyn Chanussot,et al.  Challenges and Opportunities of Multimodality and Data Fusion in Remote Sensing , 2014, Proceedings of the IEEE.

[65]  Huiji Gao,et al.  Harnessing the Crowdsourcing Power of Social Media for Disaster Relief , 2011, IEEE Intelligent Systems.

[66]  M. Jackson,et al.  Games on Networks , 2014 .

[67]  Hassina Seridi-Bouchelaghem,et al.  A significant core structure inside the social network evolutionary process , 2016, Social Network Analysis and Mining.

[68]  Yogesh Kumar Dwivedi,et al.  Smart cities: Advances in research - An information systems perspective , 2019, Int. J. Inf. Manag..

[69]  Neda Mohammadi,et al.  Smart city digital twins , 2017, 2017 IEEE Symposium Series on Computational Intelligence (SSCI).

[70]  Wen-Lung Shiau,et al.  Co-citation and cluster analyses of extant literature on social networks , 2017, Int. J. Inf. Manag..

[71]  Ole-Christoffer Granmo,et al.  Deep CNN-ELM Hybrid Models for Fire Detection in Images , 2018, ICANN.