DroneVR: A Web Virtual Reality Simulator for Drone Operator

In recent years, Unmanned Aerial Vehicle (UAV) has been used extensively in various applications from entertainment, virtual tourism to construction, mining, agriculture. Navigation, path planning, and image acquisition are the main tasks in administering these aerial devices in accordance with real-time object tracking for affordable aerial vehicles. Aircraft crash is one of the most critical issues due to the uncontrolled environment and signal loss that cause the aerial vehicle to hit the buildings on its returning mode. Furthermore, real-time image processing, such as object tracking, has not yet been exploited for a low-cost aerial vehicle. This paper proposes a prototype embedded in a Web-based application called DroneVR to mitigate the aforementioned issues. The virtual reality environment was reconstructed based on the real-world fly data (OpenStreetMap) in which path planning and navigation were carried out. Gaussian Mixture Model was used to extract foreground and detect a moving object, Kalman Filter method was then applied to predict and keep track of object's motion. Perceived ease of use was investigated with a small sample size users to improve the simulator.

[1]  Richard Bellman,et al.  Dynamic Programming Treatment of the Travelling Salesman Problem , 1962, JACM.

[2]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[3]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[4]  Vinh Thai Nguyen,et al.  Setting up Virtual Reality and Augmented Reality Learning Environment in Unity , 2017, 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct).

[5]  Fred D. Davis A technology acceptance model for empirically testing new end-user information systems : theory and results , 1985 .

[6]  E. Lynn Usery,et al.  Implications of Web Mercator and Its Use in Online Mapping , 2014, Cartogr. Int. J. Geogr. Inf. Geovisualization.

[7]  Ngan V. T. Nguyen,et al.  HiperVR: A Virtual Reality model for Visualizing Multidimensional Health Status of High Performance Computing Systems , 2019, PEARC.

[8]  Jesse Paterson,et al.  Improving Usability, Efficiency, and Safety of UAV Path Planning through a Virtual Reality Interface , 2019, SUI.

[9]  Brian Danchilla,et al.  Three.js Framework , 2012 .

[10]  Tommy Dang,et al.  Learners' Technological Acceptance of VR Content Development: A Sequential 3-Part Use Case Study of Diverse Post-Secondary Students , 2019, Int. J. Semantic Comput..

[11]  Mark T. Bolas,et al.  Mixed reality for robotics , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Patrick Weber,et al.  OpenStreetMap: User-Generated Street Maps , 2008, IEEE Pervasive Computing.

[13]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[14]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[15]  Luigi di Stefano,et al.  A simple and efficient connected components labeling algorithm , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[16]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[17]  Randy Cahya Wihandika,et al.  An Analysis of RGB, Hue and Grayscale under Various Illuminations , 2018, 2018 International Conference on Sustainable Information Engineering and Technology (SIET).

[18]  Francesca De Crescenzio,et al.  A First Implementation of an Advanced 3D Interface to Control and Supervise UAV (Uninhabited Aerial Vehicles) Missions , 2009, PRESENCE: Teleoperators and Virtual Environments.

[19]  Greg Welch,et al.  Welch & Bishop , An Introduction to the Kalman Filter 2 1 The Discrete Kalman Filter In 1960 , 1994 .

[20]  Behnam Askarian,et al.  Smartphone with optical, physical, and electrochemical nanobiosensors , 2019, Journal of Industrial and Engineering Chemistry.

[21]  Vinh Thai Nguyen,et al.  Web-Based Virtual Reality Development in Classroom: From Learner's Perspectives , 2018, 2018 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR).

[22]  Jared Scott Managing multiple unmanned aerial vehicles from a 3D virtual environment , 2006 .

[23]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.