Exploring city digital twins as policy tools: A task-based approach to generating synthetic data on urban mobility

Abstract This article discusses the technology of city digital twins (CDTs) and its potential applications in the policymaking context. The article analyzes the history of the development of the concept of digital twins and how it is now being adopted on a city-scale. One of the most advanced projects in the field—Virtual Singapore—is discussed in detail to determine the scope of its potential domains of application and highlight challenges associated with it. Concerns related to data privacy, availability, and its applicability for predictive simulations are analyzed, and potential usage of synthetic data is proposed as a way to address these challenges. The authors argue that despite the abundance of urban data, the historical data are not always applicable for predictions about the events for which there does not exist any data, as well as discuss the potential privacy challenges of the usage of micro-level individual mobility data in CDTs. A task-based approach to urban mobility data generation is proposed in the last section of the article. This approach suggests that city authorities can establish services responsible for asking people to conduct certain activities in an urban environment in order to create data for possible policy interventions for which there does not exist useful historical data. This approach can help in addressing the challenges associated with the availability of data without raising privacy concerns, as the data generated through this approach will not represent any real individual in society.

[1]  Bernard Rous,et al.  The ACM digital library , 2001, CACM.

[2]  Albert-László Barabási,et al.  Understanding individual human mobility patterns , 2008, Nature.

[3]  Xing Xie,et al.  GeoLife: A Collaborative Social Networking Service among User, Location and Trajectory , 2010, IEEE Data Eng. Bull..

[4]  Julian Togelius,et al.  Measuring Intelligence through Games , 2011, ArXiv.

[5]  Thomas L. Martin,et al.  A survey on predicting personal mobility , 2012, Int. J. Pervasive Comput. Commun..

[6]  Edward H. Glaessgen,et al.  The Digital Twin Paradigm for Future NASA and U.S. Air Force Vehicles , 2012 .

[7]  Dino Pedreschi,et al.  Understanding the patterns of car travel , 2013 .

[8]  Guillaume Deffuant,et al.  Generating a Synthetic Population of Individuals in Households: Sample-Free Vs Sample-Based Methods , 2012, J. Artif. Soc. Soc. Simul..

[9]  Emilio Frazzoli,et al.  A review of urban computing for mobile phone traces: current methods, challenges and opportunities , 2013, UrbComp '13.

[10]  Manuel Oliva,et al.  Product Avatar as Digital Counterpart of a Physical Individual Product: Literature Review and Implications in an Aircraft , 2015, ISPE CE.

[11]  Gerd Kortuem,et al.  Urban Data Games: Creating Smart Citizens for Smart Cities , 2015, 2015 IEEE 15th International Conference on Advanced Learning Technologies.

[12]  Jaime Lloret,et al.  Development of a Conductivity Sensor for Monitoring Groundwater Resources to Optimize Water Management in Smart City Environments , 2015, Sensors.

[13]  Nilay Shah,et al.  A Methodology for Simulating Synthetic Populations for the Analysis of Socio-technical Infrastructures , 2015, ESSA.

[14]  Alan M. MacEachren,et al.  Geo-Located Tweets. Enhancing Mobility Maps and Capturing Cross-Border Movement , 2015, PloS one.

[15]  Arkady B. Zaslavsky,et al.  Waste Management as an IoT-Enabled Service in Smart Cities , 2015, NEW2AN.

[16]  Vladlen Koltun,et al.  Playing for Data: Ground Truth from Computer Games , 2016, ECCV.

[17]  Honglak Lee,et al.  Control of Memory, Active Perception, and Action in Minecraft , 2016, ICML.

[18]  Stefan Boschert,et al.  Digital Twin—The Simulation Aspect , 2016 .

[19]  Rolf Moeckel,et al.  Towards an Agent-based, Integrated Land-use Transport Modeling System , 2016, ANT/SEIT.

[20]  Antonio M. López,et al.  The SYNTHIA Dataset: A Large Collection of Synthetic Images for Semantic Segmentation of Urban Scenes , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Qiao Wang,et al.  VirtualWorlds as Proxy for Multi-object Tracking Analysis , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Neda Mohammadi,et al.  Smart city digital twins , 2017, 2017 IEEE Symposium Series on Computational Intelligence (SSCI).

[23]  Stephen Potter,et al.  Engaging with the Smart City Through Urban Data Games , 2017 .

[24]  Michael W. Grieves,et al.  Digital Twin: Mitigating Unpredictable, Undesirable Emergent Behavior in Complex Systems , 2017 .

[25]  Nick Barnes,et al.  Photo-Realistic Simulation of Road Scene for Data-Driven Methods in Bad Weather , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[26]  Matthew Johnson-Roberson,et al.  Driving in the Matrix: Can virtual worlds replace human-generated annotations for real world tasks? , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[27]  L. A. Verhoef,et al.  Fuel cell electric vehicle as a power plant: Fully renewable integrated transport and energy system design and analysis for smart city areas , 2017 .

[28]  Ralf-Martin Soe,et al.  Smart Twin Cities via Urban Operating System , 2017, ICEGOV.

[29]  Meng Zhang,et al.  Digital Twin Shop-Floor: A New Shop-Floor Paradigm Towards Smart Manufacturing , 2017, IEEE Access.

[30]  Marc Pollefeys,et al.  Slanted Stixels: Representing San Francisco's Steepest Streets , 2017, BMVC.

[31]  Jonathan Leidig,et al.  Generative models for synthetic populations , 2017, SummerSim.

[32]  Gilles Vuidel,et al.  Generating a Located Synthetic Population of Individuals, Households, and Dwellings , 2017 .

[33]  I. Graessler,et al.  Integration of a digital twin as human representation in a scheduling procedure of a cyber-physical production system , 2017, 2017 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM).

[34]  Ismail Güvenç,et al.  UAV-Enabled Intelligent Transportation Systems for the Smart City: Applications and Challenges , 2017, IEEE Communications Magazine.

[35]  Marina Levina.  FIDELITY OF THE DIGITAL TWIN , 2018 .

[36]  Hao Wu,et al.  Generating Realistic Synthetic Population Datasets , 2016, ACM Trans. Knowl. Discov. Data.

[37]  Jacek Izydorczyk,et al.  In Search of the Ultimate Autonomous Driving Simulator , 2018, 2018 International Conference on Signals and Electronic Systems (ICSES).

[38]  Won-Hwa Hong,et al.  Exploiting IoT and big data analytics: Defining Smart Digital City using real-time urban data , 2017, Sustainable Cities and Society.

[39]  Victor M. Preciado,et al.  Digital Behavioral Twins for Safe Connected Cars , 2018, MoDELS.

[40]  Maria Pampaka,et al.  Differential Correct Attribution Probability for Synthetic Data: An Exploration , 2018, PSD.

[41]  Xiaojing Huang,et al.  MODELING TREES FOR VIRTUAL SINGAPORE: FROM DATA ACQUISITION TO CITYGML MODELS , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[42]  Hyeon Park,et al.  Smart Livestock Farms Using Digital Twin: Feasibility Study , 2018, 2018 International Conference on Information and Communication Technology Convergence (ICTC).

[43]  Arvind Easwaran,et al.  Challenges in Digital Twin Development for Cyber-Physical Production Systems , 2018, CyPhy/WESE.

[44]  Eran Toch,et al.  Analyzing large-scale human mobility data: a survey of machine learning methods and applications , 2019, Knowledge and Information Systems.

[45]  Sushil Jajodia,et al.  Data Synthesis based on Generative Adversarial Networks , 2018, Proc. VLDB Endow..

[46]  Guangchun Luo,et al.  Location prediction on trajectory data: A review , 2018, Big Data Min. Anal..

[47]  Fei Tao,et al.  Digital Twin and Big Data Towards Smart Manufacturing and Industry 4.0: 360 Degree Comparison , 2018, IEEE Access.

[48]  P. Maglio,et al.  Smart cities with big data: Reference models, challenges, and considerations , 2018, Cities.

[49]  John-Thones Amenyo.  Using Digital Twins and Intelligent Cognitive Agencies to Build Platforms for Automated CxO Future of Work , 2018, ArXiv.

[50]  Steven M. Bellovin,et al.  Privacy and Synthetic Datasets , 2018 .

[51]  Mikko Martikka,et al.  Smart City Platform Enabling Digital Twin , 2018, 2018 International Conference on Intelligent Systems (IS).

[52]  Jeroen van den Hoven,et al.  Digital Twins in Health Care: Ethical Implications of an Emerging Engineering Paradigm , 2018, Front. Genet..

[53]  Wilfried Sihn,et al.  Digital Twin in manufacturing: A categorical literature review and classification , 2018 .

[54]  K. Soon,et al.  Towards an Underground Utilities 3D Data Model for Land Administration , 2019 .

[55]  Using Mobility Profiles for Synthetic Population Generation , 2019, ESSA.

[56]  Wanggen Wan,et al.  Comparison of Main Approaches for Extracting Behavior Features from Crowd Flow Analysis , 2019, ISPRS Int. J. Geo Inf..

[57]  Claudia Yamu,et al.  Digital Twin, Virtual Reality and Space Syntax: Civic engagement and decision support for smart, sustainable cities , 2019 .

[58]  Rudolf Mayer,et al.  On the Utility of Synthetic Data: An Empirical Evaluation on Machine Learning Tasks , 2019, ARES.

[59]  Toivo Tähemaa,et al.  DIGITAL TWIN BASED SYNCHRONISED CONTROL AND SIMULATION OF THE INDUSTRIAL ROBOTIC CELL USING VIRTUAL REALITY , 2019, Journal of Machine Engineering.

[60]  Hao Wu,et al.  An Agent-based Model Simulation of Human Mobility Based on Mobile Phone Data: How Commuting Relates to Congestion , 2019, ISPRS Int. J. Geo Inf..

[61]  Michael Weyrich,et al.  The Facets of Digital Twins in Production and the Automotive Industry , 2019, 2019 23rd International Conference on Mechatronics Technology (ICMT).

[62]  Jingchen Hu,et al.  Bayesian Estimation of Attribute and Identification Disclosure Risks in Synthetic Data , 2018, Trans. Data Priv..

[63]  Olga Zvereva,et al.  Hybrid Automaton Implementation For Intelligent Agents’ Behavior Modelling , 2019, 2019 International Conference on Information Science and Communications Technologies (ICISCT).

[64]  Fei Wang,et al.  A Novel Cloud-Based Framework for the Elderly Healthcare Services Using Digital Twin , 2019, IEEE Access.

[65]  Sergey I. Nikolenko.  Synthetic Data for Deep Learning , 2019, ArXiv.

[66]  Nadja Hoßbach,et al.  Dimensions of Digital Twin Applications - A Literature Review , 2019, AMCIS.

[67]  Li Wan,et al.  Developing a City-Level Digital Twin –Propositions and a Case Study , 2019, International Conference on Smart Infrastructure and Construction 2019 (ICSIC).

[68]  Kurt Keutzer,et al.  SqueezeSegV2: Improved Model Structure and Unsupervised Domain Adaptation for Road-Object Segmentation from a LiDAR Point Cloud , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[69]  He Zhang,et al.  Digital Twin in Industry: State-of-the-Art , 2019, IEEE Transactions on Industrial Informatics.

[70]  Wael Hafez,et al.  Human Digital Twin: Enabling Human-Multi Smart Machines Collaboration , 2019, IntelliSys.

[71]  Claudia Yamu,et al.  Urban Digital Twins for Smart Cities and Citizens: The Case Study of Herrenberg, Germany , 2020, Sustainability.

[72]  Qi Wang,et al.  Cognition Digital Twins for Personalized Information Systems of Smart Cities: Proof of Concept , 2020, Journal of Management in Engineering.

[73]  Julian Togelius,et al.  Deep Learning for Video Game Playing , 2017, IEEE Transactions on Games.

[74]  M. Krauland,et al.  Development of a Synthetic Population Model for Assessing Excess Risk for Cardiovascular Disease Death , 2020, JAMA network open.

[75]  Zhipeng Cai,et al.  Collaborative City Digital Twin For Covid-19 Pandemic: A Federated Learning Solution , 2020, ArXiv.

[76]  Kaan Ozbay,et al.  Evaluation of city-scale built environment policies in New York City with an emerging-mobility-accessible synthetic population , 2020 .

[77]  Bruno Lepri,et al.  Deep Learning for Human Mobility: a Survey on Data and Models , 2020, ArXiv.

[78]  Zhong Fan,et al.  Digital Twin: Enabling Technologies, Challenges and Open Research , 2019, IEEE Access.

[79]  Lin Padgham,et al.  Building a large synthetic population from Australian census data , 2020, ArXiv.

[80]  Neda Mohammadi,et al.  Knowledge Discovery in Smart City Digital Twins , 2020, HICSS.

[81]  John E. Taylor,et al.  Smart City Digital Twin–Enabled Energy Management: Toward Real-Time Urban Building Energy Benchmarking , 2020, Journal of Management in Engineering.

[82]  Gerhard Schrotter,et al.  The Digital Twin of the City of Zurich for Urban Planning , 2020, PFG – Journal of Photogrammetry, Remote Sensing and Geoinformation Science.

[83]  Abdulmotaleb El Saddik,et al.  An ISO/IEEE 11073 Standardized Digital Twin Framework for Health and Well-Being in Smart Cities , 2020, IEEE Access.

[84]  Jason Yon,et al.  Characterising the Digital Twin: A systematic literature review , 2020, CIRP Journal of Manufacturing Science and Technology.

[85]  Xiang Xie,et al.  Developing a Digital Twin at Building and City Levels: Case Study of West Cambridge Campus , 2020, Journal of Management in Engineering.

[86]  Herman van der Auweraer,et al.  Digital Twins , 2020, SEMA SIMAI Springer Series.

[87]  A. Brintrup,et al.  Digital Twins: State of the Art Theory and Practice, Challenges, and Open Research Questions , 2020, J. Ind. Inf. Integr..

[88]  Yogesh Kumar Dwivedi,et al.  Security, Privacy and Risks Within Smart Cities: Literature Review and Development of a Smart City Interaction Framework , 2020, Information systems frontiers : a journal of research and innovation.

[89]  Gorka Epelde,et al.  Reliability of Supervised Machine Learning Using Synthetic Data in Health Care: Model to Preserve Privacy for Data Sharing , 2020, JMIR medical informatics.

[90]  Dimitris Mourtzis,et al.  Simulation in the design and operation of manufacturing systems: state of the art and new trends , 2019, Int. J. Prod. Res..

[91]  Jie Feng,et al.  Learning to Simulate Human Mobility , 2020, KDD.

[92]  A. Parlikad,et al.  A Socio-Technical Perspective on Urban Analytics: The Case of City-Scale Digital Twins , 2020, Journal of Urban Technology.

[93]  Barbara Rita Barricelli,et al.  Human Digital Twin for Fitness Management , 2020, IEEE Access.

[94]  Alison Heppenstall,et al.  Dealing with uncertainty in agent-based models for short-term predictions , 2019, Royal Society Open Science.

[95]  Andreas Vogelsang,et al.  Destination Prediction Based on Partial Trajectory Data , 2020, 2020 IEEE Intelligent Vehicles Symposium (IV).

[96]  S. Q. Dou,et al.  RESEARCH ON CONSTRUCTION OF SPATIO-TEMPORAL DATA VISUALIZATION PLATFORM FOR GIS AND BIM FUSION , 2020, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[97]  Yacine Rezgui,et al.  Towards a semantic Construction Digital Twin: Directions for future research , 2020, Automation in Construction.

[98]  Youngjib Ham,et al.  Participatory Sensing and Digital Twin City: Updating Virtual City Models for Enhanced Risk-Informed Decision-Making , 2020 .

[99]  Kean Huat Soon,et al.  From underground utility survey to land administration: An underground utility 3D data model , 2021 .

[100]  Cheng Zhang,et al.  Disaster City Digital Twin: A vision for integrating artificial and human intelligence for disaster management , 2021, Int. J. Inf. Manag..

[101]  Marcel Antal,et al.  An Overview of Digital Twins Application Domains in Smart Energy Grid , 2021, ArXiv.

[102]  Siobhán Clarke,et al.  A digital twin smart city for citizen feedback , 2021 .

[103]  Shao Zhenfeng,et al.  Smart city based on digital twins , 2021, Computational Urban Science.

[104]  Z. Shen,et al.  A systematic review of a digital twin city: A new pattern of urban governance toward smart cities , 2021 .

[105]  Chunho Yeom,et al.  City Digital Twin Potentials: A Review and Research Agenda , 2021, Sustainability.

[106]  Ali Ahmad Malik,et al.  Framework to model virtual factories: a digital twin view , 2021, ArXiv.

[107]  Dong Zhao,et al.  TraG: A Trajectory Generation Technique for Simulating Urban Crowd Mobility , 2021, IEEE Transactions on Industrial Informatics.

[108]  Fida K. Dankar,et al.  Fake It Till You Make It: Guidelines for Effective Synthetic Data Generation , 2021, Applied Sciences.

[109]  Dimitris Kiritsis,et al.  Actionable cognitive twins for decision making in manufacturing , 2021, Int. J. Prod. Res..