Virtual Reality for Smart City Visualization and Monitoring

In the present Internet of Things (IoT) era, smart city components (e.g. Smart buildings, Smart infrastructures, etc.) are increasingly embracing cutting edge technologies to support complex scenarios that include decision-making, prediction and intelligent actuation. In this context, there is an increased need for information visualization, so as to propagate information to end users in a smart, sustainable, and resilient way. Currently, despite the growth of the IoT sector, many IoT operators only provide static visualizations. However, interactive data visualizations are required to achieve deeper and faster insights, beyond what is available in existing infrastructure, towards supporting decision-making by city authorities; while offering real time information to citizens. This paper builds on top of ongoing research work carried out at the Human Computer Interaction (HCI) Laboratory of ICS-FORTH in the domain of visualizing and interacting with information in Ambient Intelligence environments, in order to propose the design of an interactive Smart City Visualization framework. In this context, advanced user interaction techniques can be employed, including gesture-based interaction with high resolution large screen displays in alternative contexts of use and immersive VR experiences. To this end, several gesture-based interaction techniques have been validated to propose a sufficiently rich set of gestures that are adaptable to user and context requirements and are ergonomic, intuitive, and easy to perform and remember, while remaining metaphorically appropriate for the addressed functionality. Additionally, Big Data visualization is accomplished by employing 3D solutions. The proposed design supports experiencing and interacting with information through VR technologies and large displays, offering improved data visualization capacity and enhanced data dimensionality, thus overcoming issues related to data complexity and heterogeneity.

[1]  Constantine Stephanidis,et al.  3D Vizualization of Large Scale Data Centres , 2016, CLOSER.

[2]  Kaj Suneson Virtual Reality in City Planning - A Longitudinal Study , 2014 .

[3]  Parth Rajesh Desai,et al.  A Review Paper on Oculus Rift-A Virtual Reality Headset , 2014, ArXiv.

[4]  Ye Zhao,et al.  TrajGraph: A Graph-Based Visual Analytics Approach to Studying Urban Network Centralities Using Taxi Trajectory Data , 2016, IEEE Transactions on Visualization and Computer Graphics.

[5]  Mark Billinghurst,et al.  Grasp-Shell vs gesture-speech: A comparison of direct and indirect natural interaction techniques in augmented reality , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[6]  Rodrigo Torres,et al.  Interactive Virtual Reality Navigation Using Cave Automatic Virtual Environment Technology , 2019, Encyclopedia of Computer Graphics and Games.

[7]  Rik Van de Walle,et al.  What Public Transit API Logs Tell Us about Travel Flows , 2016, WWW.

[8]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[9]  Nigel Davies,et al.  Repurposing Web Analytics to Support the IoT , 2015, Computer.

[10]  Neha Gupta,et al.  Challenges and Security Issues of Distributed Databases , 2017 .

[11]  Khaleel Ahmad,et al.  Hands-On InfluxDB , 2017 .

[12]  Kimio Oguchi,et al.  SensMap: Web framework for complex visualization of indoor & outdoor sensing systems , 2013, International Conference on Indoor Positioning and Indoor Navigation.

[13]  Liu Chunyan,et al.  Prediction of Construction Land in Kunming Based on Big Data , 2016, 2016 International Conference on Intelligent Transportation, Big Data & Smart City (ICITBS).

[14]  Massimo Bergamasco,et al.  I'm in VR!: using your own hands in a fully immersive MR system , 2014, VRST '14.

[15]  Pietro Zanuttigh,et al.  Hand gesture recognition with leap motion and kinect devices , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[16]  Ilona Heldal,et al.  Virtual reality as a new tool in the city planning process , 2008 .

[17]  Olivier Chapuis,et al.  Mid-air pan-and-zoom on wall-sized displays , 2011, CHI.

[18]  Olaf Kolditz,et al.  Concept and workflow for 3D visualization of atmospheric data in a virtual reality environment for analytical approaches , 2014, Environmental Earth Sciences.

[19]  Xin Zhang,et al.  A New Writing Experience: Finger Writing in the Air Using a Kinect Sensor , 2013, IEEE MultiMedia.

[20]  Michael Batty,et al.  Visual Analytics for Urban Design , 2014 .

[21]  Tuck Wah Leong,et al.  Exploring Gameplay Experiences on the Oculus Rift , 2015, CHI PLAY.

[22]  Liane Thuvander,et al.  In search of visualization challenges: The development and implementation of visualization tools for supporting dialogue in urban planning processes , 2017 .

[23]  Raffaele De Amicis,et al.  Geo-visual analytics for urban design in the context of future internet , 2009 .

[24]  Philippe Coiffet,et al.  Virtual Reality Technology , 2003, Presence: Teleoperators & Virtual Environments.

[25]  Marimuthu Palaniswami,et al.  Internet of Things (IoT): A vision, architectural elements, and future directions , 2012, Future Gener. Comput. Syst..

[26]  Ashutosh Tiwari,et al.  Combining virtual reality enabled simulation with 3D scanning technologies towards smart manufacturing , 2016, 2016 Winter Simulation Conference (WSC).

[27]  N. Levine Crime Mapping and the CrimeStat Program , 2006 .

[28]  Nikolaos Doulamis,et al.  ONLINE 4D RECONSTRUCTION USING MULTI-IMAGES AVAILABLE UNDER OPEN ACCESS , 2013 .

[29]  Jeffrey S. Norris,et al.  Immersive and collaborative data visualization using virtual reality platforms , 2014, 2014 IEEE International Conference on Big Data (Big Data).

[30]  Weixi Wang,et al.  WebVRGIS based traffic analysis and visualization system , 2016, Adv. Eng. Softw..

[31]  Ilaria Greco,et al.  From SMART Cities to SMART City-Regions: Reflections and Proposals , 2017, ICCSA.

[32]  Aleksandr Ometov,et al.  Visualizing Big Data with augmented and virtual reality: challenges and research agenda , 2015, Journal of Big Data.

[33]  Francisco C. Pereira,et al.  Using Data From the Web to Predict Public Transport Arrivals Under Special Events Scenarios , 2015, J. Intell. Transp. Syst..

[34]  Zhihan Lv,et al.  Virtual Reality Based GIS Analysis Platform , 2015, ICONIP.

[35]  Michael Leitner,et al.  Crime Modeling and Mapping Using Geospatial Technologies , 2013 .

[36]  Daniel A. Keim,et al.  Visual analytics for the big data era — A comparative review of state-of-the-art commercial systems , 2012, 2012 IEEE Conference on Visual Analytics Science and Technology (VAST).

[37]  Fahmi Fahmi,et al.  Integrated pollution monitoring system for smart city , 2016, 2016 International Conference on ICT For Smart Society (ICISS).

[38]  Michael Blackstock,et al.  IoT mashups with the WoTKit , 2012, 2012 3rd IEEE International Conference on the Internet of Things.

[39]  Oliver Burgert,et al.  Touch-Free, Gesture-Based Control of Medical Devices and Software Based on the Leap Motion Controller , 2014, MMVR.

[40]  Nasiroh Omar,et al.  Interactive Big Data Visualization Model Based on Hot Issues (Online News Articles) , 2016, SCDS.

[41]  Constantine Stephanidis,et al.  Immersive 3D Environment for Data Centre Monitoring Based on Gesture Based Interaction , 2017, HCI.