Towards a methodology to build virtual reality manufacturing systems based on free open software technologies

Virtual reality and augmented reality are being increasingly used in the manufacturing field for different purposes. As a result, these technologies seem to have a very promising future in the manufacturing industry. However, most of the current applications are based on the use of expensive proprietary software packages (such as specific CAD modules). This work presents a methodology that helps programmers to build virtual and augmented reality systems, which is valid for a broad number of industrial plants. Differently to other approaches, ours is based on open technologies, most of them free of cost. The technologies proposed to build the virtual worlds are already mature at the entertainment industry. The presented approach opens new possibilities for creating virtual reality models aimed at two major directions: (1) pure simulation of real processes and products for different purposes (e.g. staff training; prototype designing; manufacturing optimization; marketing) and (2) teleoperation of real processes (e.g. in dangerous environments or in micro and macro scale manufacturing). The application of the methodology is illustrated by means of the creation of a non-immersive virtual world which represents a part-classifying station, allowing both the simulation of the real plant as well as its remote operation.

[1]  Luís Gomes,et al.  Current Trends in Remote Laboratories , 2009, IEEE Transactions on Industrial Electronics.

[2]  John Simmons,et al.  Assembly planning in a virtual environment , 1997, Innovation in Technology Management. The Key to Global Leadership. PICMET '97.

[3]  Khelf Mohamed,et al.  Design of mobile robot teleoperation system based on virtual reality , 2015, 2015 3rd International Conference on Control, Engineering & Information Technology (CEIT).

[4]  Adel Sghaier,et al.  Using high-level models for modeling industrial machines in a virtual environment , 2008 .

[5]  Marcello Pellicciari,et al.  Hybrid Reconfigurable System design and optimization through virtual prototyping and digital manufacturing tools , 2012 .

[6]  Satish Tyagi,et al.  Immersive virtual reality to vindicate the application of value stream mapping in an US-based SME , 2015, The International Journal of Advanced Manufacturing Technology.

[7]  Herman Bruyninckx.  Robotics Software: The Future Should Be Open [Position] , 2008, IEEE Robotics & Automation Magazine.

[8]  Dario Orive,et al.  Building complex remote learning laboratories , 2009, Comput. Appl. Eng. Educ..

[9]  Wenshan Hu,et al.  Web-Based 3-D Control Laboratory for Remote Real-Time Experimentation , 2013, IEEE Transactions on Industrial Electronics.

[10]  George-Christopher Vosniakos,et al.  Design of a virtual reality training system for human–robot collaboration in manufacturing tasks , 2015, International Journal on Interactive Design and Manufacturing (IJIDeM).

[11]  F. M. Schaf,et al.  Control and automation engineering education: Combining physical, remote and virtual labs , 2012, International Multi-Conference on Systems, Sygnals & Devices.

[12]  Paulo Fernandes,et al.  Development of a mechanical maintenance training simulator in OpenSimulator for F-16 aircraft engines , 2014, Entertain. Comput..

[13]  Herman Bruyninckx.  Robotics Software: The Future Should Be Open , 2008 .

[14]  Yuka Kato.  A remote navigation system for a simple tele-presence robot with virtual reality , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Marga Marcos,et al.  A methodology based on distributed object-oriented technologies for providing remote access to industrial plants , 2006 .

[16]  Lihui Wang,et al.  Collaborative robot monitoring and control for enhanced sustainability , 2015 .

[17]  Mascha C. van der Voort,et al.  A new product design method based on virtual reality, gaming and scenarios , 2008 .

[18]  Henry Fuchs,et al.  Immersive 3D Telepresence , 2014, Computer.

[19]  S. Langer,et al.  Integrating immersive 3D worlds and real lab equipment for teaching mechatronics , 2012, 2012 9th International Conference on Remote Engineering and Virtual Instrumentation (REV).

[20]  Liang Zhong,et al.  A DC Motor Position Control System in a 3D Real-Time Virtual Laboratory Environment Based on NCSLab 3D , 2015, Int. J. Online Eng..

[21]  Imre J. Rudas,et al.  Merged physical and virtual reality in collaborative virtual workspaces: The VirCA approach , 2014, IECON 2014 - 40th Annual Conference of the IEEE Industrial Electronics Society.

[22]  Angélica de Antonio Jiménez,et al.  An architecture for virtual labs in engineering education , 2012, Proceedings of the 2012 IEEE Global Engineering Education Conference (EDUCON).

[23]  Peter Mitrouchev,et al.  Disassembly operations’ efficiency evaluation in a virtual environment , 2016, Int. J. Comput. Integr. Manuf..

[24]  Michele Germani,et al.  Advanced computer aided technologies for design automation in footwear industry , 2011 .

[25]  Monica Bordegoni,et al.  Prototyping strategies for multisensory product experience engineering , 2015, Journal of Intelligent Manufacturing.

[26]  Manoj Kumar Tiwari,et al.  Optimal part orientation in layered manufacturing using evolutionary stickers-based DNA algorithm , 2007 .

[27]  Alan Miller,et al.  A taxonomy of virtual worlds usage in education , 2012, Br. J. Educ. Technol..

[28]  Yajun Lu,et al.  A review of micro-devices assembly techniques and technology , 2016 .

[29]  Dennis F. X. Mathaisel,et al.  A paradigm for benchmarking lean initiatives for quality improvement , 2000 .

[30]  Stephen Travis Pope,et al.  A cookbook for using the model-view controller user interface paradigm in Smalltalk-80 , 1988 .

[31]  Petr Hořejší,et al.  Augmented Reality System for Virtual Training of Parts Assembly , 2015 .

[32]  Sang C. Park,et al.  Survey on the virtual commissioning of manufacturing systems , 2014, J. Comput. Des. Eng..

[33]  Z. Zacharia,et al.  Physical and Virtual Laboratories in Science and Engineering Education , 2013, Science.

[34]  Ben Horan,et al.  Multipoint Haptic Mediator Interface for Robotic Teleoperation , 2015, IEEE Systems Journal.

[35]  Soh-Khim Ong,et al.  Towards a griddable distributed manufacturing system with augmented reality interfaces , 2016 .

[36]  Maurice Hendrix,et al.  Game engines selection framework for high-fidelity serious applications , 2012 .

[37]  Kuo-Ming Chao,et al.  VR-based wheeled mobile robot in application of remote real-time assembly , 2013 .

[38]  Alan Miller,et al.  An immersive platform for collaborative projects , 2014, 2014 IEEE Frontiers in Education Conference (FIE) Proceedings.

[39]  Glyn Lawson,et al.  The use of virtual reality and physical tools in the development and validation of ease of entry and exit in passenger vehicles. , 2015, Applied ergonomics.

[40]  Imre J. Rudas,et al.  Design, programming and orchestration of heterogeneous manufacturing systems through VR-powered remote collaboration , 2015 .