Interoperable architecture for joint real/virtual training in emergency management using the MPEG-V standard

Operatives' training is crucial in emergency management. Traditional exercises to improve procedures interoperability and harmonization between agencies are complex and expensive. Research on command and control systems specifically designed for emergency management and on virtual reality use leads towards enhancing real world applications' capabilities, facilitating management and optimizing resource usage.This paper proposes a new architecture for a training system based on the interconnection between real and virtual worlds extending the MPEG-V standard; allowing real and virtual units' simultaneous and real-time training using commercial off-the-shelf equipment, and including a novel subsystem for video management from both real and virtual sources. An architecture for joint real/virtual training in emergency management is proposed.Deployment of a middleware using MPEG-V where different applications interoperate.Deployment and integration of a subsystem for video managementThe proposed system improves the ways of actuation and response in crisis events.The system has a satisfactory performance and that the use of resources is adequate.

[1]  Eliot Feibush,et al.  Visualization for Situational Awareness , 2000, IEEE Computer Graphics and Applications.

[2]  Kyoungro Yoon,et al.  4-D broadcasting with MPEG-V , 2010, 2010 IEEE International Workshop on Multimedia Signal Processing.

[3]  Kyoungro Yoon,et al.  Streaming Media with Sensory Effect , 2011, 2011 International Conference on Information Science and Applications.

[4]  Jae-Joon Han,et al.  Connecting users to virtual worlds within MPEG-V standardization , 2013, Signal Process. Image Commun..

[5]  Jean H.A. Gelissen,et al.  The Metaverse1 Case: Historical Review of Making one Virtual Worlds Standard (MPEG-V) , 2011 .

[6]  Kei-Hoi Cheung,et al.  Web GIS in practice VI: a demo playlist of geo-mashups for public health neogeographers , 2008, International journal of health geographics.

[7]  Mohan S. Kankanhalli,et al.  Real-life events in multimedia: detection, representation, retrieval, and applications , 2013, Multimedia Tools and Applications.

[8]  Robert N. Lass,et al.  Distributed Coordination of First Responders , 2008, IEEE Internet Computing.

[9]  F. Kleinermann,et al.  VR-WISE: A Conceptual Modeling Approach for Virtual Environments , 2005 .

[10]  Jesús Ibáñez,et al.  Lessons from research on interaction with virtual environments , 2011, J. Netw. Comput. Appl..

[11]  Manuel Díaz,et al.  Using standards to integrate soft real-time components into dynamic distributed architectures , 2012, Comput. Stand. Interfaces.

[12]  Roland Geraerts,et al.  Standards in Virtual Worlds Virtual Travel Use Case Metaverse1 Project , 2011 .

[13]  Seong Gon Choi,et al.  An architecture and method using MPEG-V metadata in smartphone and sensor aggregator , 2013, 2013 15th International Conference on Advanced Communications Technology (ICACT).

[14]  Christian Timmerer,et al.  An end-to-end tool chain for Sensory Experience based on MPEG-V , 2013, Signal Process. Image Commun..

[15]  M. Esteve,et al.  SIMACET-FFT: Spanish Army friendly force tracking system , 2009, MILCOM 2009 - 2009 IEEE Military Communications Conference.

[16]  Zhihai He,et al.  Resource allocation and performance analysis of wireless video sensors , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Carlos E. Palau,et al.  SIMACOP: Small Units Management C4ISR System , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[18]  W. Johnson,et al.  Task-oriented collaboration with embodied agents in virtual worlds , 2001 .

[19]  Marius Preda,et al.  Avatars interoperability in Virtual Worlds , 2010, 2010 IEEE International Workshop on Multimedia Signal Processing.

[20]  William M. Tepfenhart,et al.  Emergency Response Workflow Resource Requirements Modeling and Analysis , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[21]  Vincent Verdot,et al.  Virtual Hybrid Communications – A Telecom Infrastructure for the Metaverse , 2011 .

[22]  Kyoungro Yoon,et al.  End-to-end framework for 4-D broadcasting based on MPEG-V standard , 2013, Signal Process. Image Commun..

[23]  Christian Timmerer,et al.  Interfacing with Virtual Worlds , 2009 .

[24]  Christian Timmerer,et al.  Sensory effects for ambient experiences in the World Wide Web , 2012, Multimedia Tools and Applications.

[25]  Chang-Gyu Lee,et al.  Construction of a haptic-enabled broadcasting system based on the MPEG-V standard , 2013, Signal Process. Image Commun..

[26]  Christian Timmerer,et al.  A toolset for the authoring, simulation, and rendering of sensory experiences , 2012, ACM Multimedia.

[27]  Greg Kipper,et al.  Augmented Reality: An Emerging Technologies Guide to AR , 2012 .

[28]  Hakim Hacid,et al.  Enhancing Navigation in Virtual Worlds through Social Networks Analysis , 2011, ISMIS.

[29]  Chang-Yeong Kim,et al.  Controlling virtual world by the real world devices with an MPEG-V framework , 2010, 2010 IEEE International Workshop on Multimedia Signal Processing.

[30]  Jae-Kwan Yun,et al.  Annotation creation and representation system of sensory effects based on MPEG-V , 2014, The 18th IEEE International Symposium on Consumer Electronics (ISCE 2014).

[31]  Johann Füller,et al.  Avatar-based innovation: Using virtual worlds for real-world innovation , 2009 .

[32]  Petros Daras,et al.  Reconstruction for 3D immersive virtual environments , 2012, 2012 13th International Workshop on Image Analysis for Multimedia Interactive Services.

[33]  Jae-Joon Han,et al.  Virtual world control system using sensed information and adaptation engine , 2013, Signal Process. Image Commun..

[34]  Ronan Querrec,et al.  Multiagents systems for virtual environment for training. application to fire-fighting. , 2004 .

[35]  Philippe Le Parc,et al.  Virtual reality to improve remote control in presence of delays , 2010, 2010 IEEE International Conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems.

[36]  Tineke M. Egyedi,et al.  Standard-compliant, but incompatible?! , 2007, Comput. Stand. Interfaces.

[37]  Craig W. Thompson,et al.  Virtual and Real-World Ontology Services , 2011, IEEE Internet Computing.

[38]  Hai He,et al.  A generic framework for modeling heterogeneous real-time systems , 2005, Comput. Stand. Interfaces.

[39]  Mel Slater,et al.  Presence in immersive virtual environments , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.