Virtual reality applications in manufacturing industries: Past research, present findings, and future directions

Today, manufacturing industries are trying to improve their competitiveness by combining manufacturing per se with information technology. Virtual reality is being used in product development processes in manufacturing enterprises as a helpful technology to achieve rapid consolidation of information and decision-making through visualization and experience. In this article, 154 articles relevant to virtual reality’s application to manufacturing were surveyed and analyzed. For this, (1) an analysis map was created, based on a virtual reality technology classification and the new product development process; (2) the articles investigated were located on the map; and (3) bibliometric analyses were carried out. Trends in past and present research were examined and future virtual reality research directions and application plans for manufacturing enterprises are discussed.

[1]  T. P. Caudell,et al.  Augmented reality: an application of heads-up display technology to manual manufacturing processes , 1992, Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences.

[2]  Jianxin Jiao,et al.  Virtual prototyping for customized product development , 1997 .

[3]  Simone Colombo,et al.  Bridging between Virtual Reality and accident simulation for training of process-industry operators , 2013, Adv. Eng. Softw..

[4]  Michael P. Bigwood,et al.  Patent trend analysis: Incorporate current year data , 1997 .

[5]  Collin Wang,et al.  Virtual-reality-based point-and-direct robotic inspection in manufacturing , 1996, IEEE Trans. Robotics Autom..

[6]  Lawrence E. Whitman,et al.  Virtual reality: its usefulness for ergonomic analysis , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[7]  Lee,et al.  [IEEE 2008 11th IEEE International Symposium on Object and Component-Oriented Real-Time Distributed Computing - Orlando, FL, USA (2008.05.5-2008.05.7)] 2008 11th IEEE International Symposium on Object and Component-Oriented Real-Time Distributed Computing (ISORC) - Cyber Physical Systems: Design Cha , 2008 .

[8]  Keiichi Watanuki,et al.  Development of virtual reality-based universal design review system , 2010 .

[9]  Dirk Schaefer,et al.  Information requirements analysis for holonic manufacturing systems in a virtual environment , 2011 .

[10]  Lars Hanson,et al.  A comparative study of digital human modelling simulation results and their outcomes in reality: A case study within manual assembly of automobiles , 2009 .

[11]  Robert Stone,et al.  Virtual reality for interactive training: an industrial practitioner's viewpoint , 2001, Int. J. Hum. Comput. Stud..

[12]  Rangasami L. Kashyap,et al.  Virtual reality interfaces for feature-based computer-aided design systems , 1997, Comput. Aided Des..

[13]  Wen-Tsai Sung,et al.  Using Virtual Reality technologies for manufacturing applications , 2003, Int. J. Comput. Appl. Technol..

[14]  S. K. Ong,et al.  Virtual reality simulations and animations in a web-based interactive manufacturing engineering module , 2004, Comput. Educ..

[15]  Jean-Claude Sagot,et al.  Systematic Development of Virtual Reality Convergence Support Tools Dedicated to Concurrent Product Design , 2013 .

[16]  Bernd Hamann,et al.  3DIVS: 3-dimensional immersive virtual sculpting , 1999, NPIVM '99.

[17]  Davy Monticolo,et al.  A collaborative Design for Usability approach supported by Virtual Reality and a Multi-Agent System embedded in a PLM environment , 2010, Comput. Aided Des..

[18]  James Millar Ritchie,et al.  The development of an integrated haptic VR machining environment for the automatic generation of process plans , 2013, Comput. Ind..

[19]  Faieza Abdul Aziz,et al.  A REVIEW OF HAPTIC FEEDBACK IN VIRTUAL REALITY FOR MANUFACTURING INDUSTRY , 2009 .

[20]  Gunther Reinhart,et al.  Integrating Augmented Reality in the Assembly Domain - Fundamentals, Benefits and Applications , 2003 .

[21]  Dave Sims,et al.  New realities in aircraft design and manufacture , 1994, IEEE Computer Graphics and Applications.

[22]  George Chryssolouris,et al.  Development of a web-based collaboration platform for manufacturing product and process design evaluation using virtual reality techniques , 2006, Int. J. Comput. Integr. Manuf..

[23]  Sang Do Noh,et al.  Virtual Manufacturing System—a Test-Bed of Engineering Activities , 1997 .

[24]  Stefano Caselli,et al.  Physics-based virtual reality for task learning and intelligent disassembly planning , 2011, Virtual Reality.

[25]  Ji Zhang,et al.  RFID-assisted assembly guidance system in an augmented reality environment , 2011 .

[26]  J. Ritchie,et al.  Automated design process modelling and analysis using immersive virtual reality , 2009, Comput. Aided Des..

[27]  Shuang Sun,et al.  The Process Planning Simulation of Multi-Axis Numerical Control Based on Virtual Reality , 2010 .

[28]  Judy M. Vance,et al.  The VR Factory : discrete event simulation implemented in a virtual environment , 2003 .

[29]  Wenjian Liu,et al.  A desktop virtual reality-based interactive modular fixture configuration design system , 2010, Comput. Aided Des..

[30]  K. Okulicz.  Virtual reality-based approach to manufacturing process planning , 2004 .

[31]  Pier Paolo Valentini,et al.  Interactive virtual assembling in augmented reality , 2009 .

[32]  Jens H. Weber,et al.  Virtual prototyping of automated manufacturing systems with Geometry-driven Petri nets , 2009, Comput. Aided Des..

[33]  Antonio Jimeno,et al.  State of the art of the virtual reality applied to design and manufacturing processes , 2007 .

[34]  Mark Mon-Williams,et al.  What does virtual reality NEED?: human factors issues in the design of three-dimensional computer environments , 1996, Int. J. Hum. Comput. Stud..

[35]  Dianliang Wu,et al.  Virtual human modeling for interactive assembly and disassembly operation in virtual reality environment , 2013, The International Journal of Advanced Manufacturing Technology.

[36]  Soonhung Han,et al.  Construction of a computer-simulated mixed reality environment for virtual factory layout planning , 2011, Comput. Ind..

[37]  Mert Bal,et al.  Virtual factory approach for implementation of holonic control in industrial applications: A case study in die-casting industry , 2009 .

[38]  S. Nahavandi,et al.  Haptically enabled interactive virtual reality prototype for general assembly , 2008, 2008 World Automation Congress.

[39]  Miguel Angel Sebastián,et al.  Virtual reality applications for the next-generation manufacturing , 2005, Int. J. Comput. Integr. Manuf..

[40]  Nick Campbell,et al.  From multimodal analysis to real-time interactions with virtual agents , 2014, Journal on Multimodal User Interfaces.

[41]  Vildan Kocar,et al.  ADVICE: A virtual environment for Engineering Change Management , 2010, Comput. Ind..

[42]  Stig Ottosson,et al.  Virtual reality in the product development process , 2002 .

[43]  Santosh Nair,et al.  Using virtual reality technology for aircraft visual inspection training: presence and comparison studies. , 2002, Applied ergonomics.

[44]  Thomas P. Caudell.  Introduction to augmented and virtual reality , 1995, Other Conferences.

[45]  J. Novak-Marcincin,et al.  Devices and software possibilities for using of motion tracking systems in the virtual reality system , 2012, 2012 IEEE 10th International Symposium on Applied Machine Intelligence and Informatics (SAMI).

[46]  Jozef Novák Marcincin,et al.  Utilization of open source tools in assembling process with application of elements of augmented reality , 2011, VRCAI.

[47]  Robert G. Cooper,et al.  Optimizing the Stage-Gate Process: What Best-Practice Companies Do—I , 2002 .

[48]  Yong Wang,et al.  VADE: A Virtual Assembly Design Environment , 1999, IEEE Computer Graphics and Applications.

[49]  Andrew Y. C. Nee,et al.  Augmented reality applications in design and manufacturing , 2012 .

[50]  Xiaohua Hu,et al.  Data Mining via Discretization, Generalization and Rough Set Feature Selection , 1999, Knowledge and Information Systems.

[51]  Tommaso Ingrassia,et al.  VirDe: a new virtual reality design approach , 2009 .

[52]  Jee-Hwan Ryu,et al.  Development of Educational System for Automotive Engineering based on Augmented Reality , 2009 .

[53]  Rajit Gadh,et al.  Virtual and Augmented Reality Technologies for Product Realization , 1999 .

[54]  Hanwu He,et al.  Web-based virtual operating of CNC milling machine tools , 2009, Comput. Ind..

[55]  Pavol Tanuska,et al.  Toward Nonconventional Human–Machine Interfaces for Supervisory Plant Process Monitoring , 2013, IEEE Transactions on Human-Machine Systems.

[56]  Edward A. Lee.  Cyber Physical Systems: Design Challenges , 2008, 2008 11th IEEE International Symposium on Object and Component-Oriented Real-Time Distributed Computing (ISORC).

[57]  Jennifer Whyte,et al.  From CAD to virtual reality : modelling approaches, data exchange and interactive 3D building design tools , 2000 .

[58]  Maria Manuela Cunha,et al.  Virtual environments for dynamically reconfigurable Concurrent/Collaborative Engineering ''virtual'' teams , 2008 .

[59]  Timothy R. Anderson,et al.  Innovation in technology management : the key to global leadership , 1997 .

[60]  Gabriel Zachmann,et al.  Virtual reality as a tool for verification of assembly and maintenance processes , 1999, Comput. Graph..

[61]  Andrew Y. C. Nee,et al.  Augmented reality for assembly guidance using a virtual interactive tool , 2008 .

[62]  Tomoichi Takahashi,et al.  Robotic assembly operation based on task-level teaching in virtual reality , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[63]  Daniel Weissmann,et al.  Middleware-based Integration of Multiple CAD and PDM Systems into Virtual Reality Environment , 2006 .

[64]  Theodore Lim,et al.  Haptic virtual reality assembly – Moving towards Real Engineering Applications , 2010 .

[65]  Grigore C. Burdea,et al.  Invited review: the synergy between virtual reality and robotics , 1999, IEEE Trans. Robotics Autom..

[66]  Hong Zhang,et al.  Interactive prostate shape reconstruction from 3D TRUS images , 2014, J. Comput. Des. Eng..

[67]  Rupert Reif,et al.  Augmented & Virtual Reality applications in the field of logistics , 2008, The Visual Computer.

[68]  Charles Pontonnier,et al.  Designing and evaluating a workstation in real and virtual environment: toward virtual reality based ergonomic design sessions , 2014, Journal on Multimodal User Interfaces.

[69]  T. Alt,et al.  Augmented Reality for manufacturing planning , 2003, IPT/EGVE.

[70]  Jonathan Corney,et al.  The Analysis of design and manufacturing tasks using haptic and immersive VR - Some case studies , 2008 .

[71]  Hyungjun Park,et al.  Tangible AR interaction based on fingertip touch using small-sized nonsquare markers , 2014, J. Comput. Des. Eng..

[72]  Schilling Arne,et al.  CAD-VR geometry and meta data synchronization for design review applications , 2006 .

[73]  Monica Bordegoni,et al.  Designing interaction with consumer products in a multisensory virtual reality environment , 2013 .

[74]  Wilhelm Dangelmaier,et al.  Virtual and augmented reality support for discrete manufacturing system simulation , 2005, Comput. Ind..

[75]  John Simmons,et al.  The generation and practical use of plans for manual assembly using immersive virtual reality , 1999 .

[76]  Christophe Nicolle,et al.  CAD data workflow toward the thermal simulation and visualization in virtual reality , 2014 .

[77]  Andrea F. Abate,et al.  A haptic-based approach to virtual training for aerospace industry , 2009, J. Vis. Lang. Comput..

[78]  Novak-Marcincin,et al.  APPLICATION OF AUGMENTED REALITY TECHNOLOGIES IN VIRTUAL MANUFACTURING , 2013 .

[79]  Abdulrahman Al-Ahmari,et al.  Virtual Assembly in a Semi-Immersive Environment , 2013 .

[80]  Yuna Kang,et al.  An alternative method for smartphone input using AR markers , 2014, J. Comput. Des. Eng..

[81]  Judy M. Vance,et al.  Applying virtual reality techniques to the interactive stress analysis of a tractor lift arm , 2000 .

[82]  Lawrence J. Najjar,et al.  An interactive environment for virtual manufacturing: the virtual work bench , 1999 .

[83]  Pascal Fua,et al.  A framework for rapid evaluation of prototypes with augmented reality , 2000, VRST '00.

[84]  Jürgen Gausemeier,et al.  AR-Planning Tool - Designing Flexible Manufacturing Systems with Augmented Reality , 2002, EGVE.

[85]  Anton Jezernik,et al.  A solution to integrate computer-aided design (CAD) and virtual reality (VR) databases in design and manufacturing processes , 2003 .

[86]  Christian Lauer,et al.  Collaborative Factory Planning in Virtual Reality , 2012 .

[87]  Arthur José Vieira Porto,et al.  Virtual manufacturing as a way for the factory of the future , 2004, J. Intell. Manuf..

[88]  Jae Yeol Lee,et al.  Tangible authoring of 3D virtual scenes in dynamic augmented reality environment , 2011, Comput. Ind..

[89]  Amarnath Banerjee,et al.  A self-configurable large-scale virtual manufacturing environment for collaborative designers , 2011, Virtual Reality.

[90]  Fabio Bruno,et al.  Innovative integration techniques between Virtual Reality systems and CAx tools , 2008 .

[91]  Sergej Hloch,et al.  Application of the Virtual Reality Modelling Language to Computer Aided Robot Control System ROANS , 2010 .

[92]  George Papagiannakis,et al.  A survey of mobile and wireless technologies for augmented reality systems , 2008, Comput. Animat. Virtual Worlds.

[93]  Sang Do Noh,et al.  A Rule-based System for the Automated Creation of VR Data for Virtual Plant Review , 2010, Concurr. Eng. Res. Appl..

[94]  R. Balachandra,et al.  Managing New Product Development Processes the Right Way , 1999, Inf. Knowl. Syst. Manag..

[95]  Kazuaki Iwata,et al.  Virtual Manufacturing Systems as Advanced Information Infrastructure for Integrating Manufacturing Resources and Activities , 1997 .

[96]  Fabio Bruno,et al.  Dynamic simulation of virtual prototypes in immersive environment , 2009 .

[97]  Jan C. Aurich,et al.  Improvement of manufacturing processes with virtual reality-based CIP workshops , 2009 .

[98]  Hamed Farahani Manesh,et al.  Virtual-reality-based information requirements analysis tool for CIM system implementation: a case study in die-casting industry , 2008, Int. J. Comput. Integr. Manuf..

[99]  B Korves,et al.  Designing an immersive virtual reality interface for layout planning , 2000 .

[100]  T. Kuhlen,et al.  Integration of virtual reality based assembly simulation into CAD/CAM environments , 1998, IECON '98. Proceedings of the 24th Annual Conference of the IEEE Industrial Electronics Society (Cat. No.98CH36200).

[101]  Kazuaki Iwata,et al.  Development of a Virtual Manufacturing System by Integrating Product Models and Factory Models , 1993 .

[102]  Qiang Li,et al.  Virtual reality for fixture design and assembly , 2009 .

[103]  Vincent G. Duffy,et al.  Perception of safe robot idle time in virtual reality and real industrial environments , 2009 .

[104]  B Korves,et al.  The application of immersive virtual reality for layout planning of manufacturing cells , 1999 .

[105]  Chi Fai Cheung,et al.  Applications of virtual manufacturing in materials processing , 2001 .

[106]  Kiran Jude Fernandes,et al.  Immersive learning system for manufacturing industries , 2003, Comput. Ind..

[107]  William A. McNeely,et al.  Robotic graphics: a new approach to force feedback for virtual reality , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[108]  Sang Do Noh,et al.  ONESVIEW: An Integrated System for One-Stop Virtual Design Review , 2010, Concurr. Eng. Res. Appl..

[109]  G. Hughes,et al.  Turning new product development into a continuous learning process , 1996 .

[110]  Sue Cobb,et al.  Integrated manufacture: A role for virtual reality? , 1995 .

[111]  Adam Hamrol,et al.  Application of Virtual Reality Techniques in Design of Ergonomic Manufacturing Workplaces , 2013, VARE.

[112]  Richard Lee Storch,et al.  Virtual Reality for Manufacturing Simulation , 1993, Proceedings of 1993 Winter Simulation Conference - (WSC '93).

[113]  George Chryssolouris,et al.  A prototype virtual reality-based demonstrator for immersive and interactive simulation of welding processes , 2006, Int. J. Comput. Integr. Manuf..

[114]  Gavin McArdle,et al.  Virtual reality for collaborative e-learning , 2008, Comput. Educ..

[115]  George Chryssolouris,et al.  A virtual reality-based experimentation environment for the verification of human-related factors in assembly processes , 2000 .

[116]  Sang Do Noh,et al.  MEMPHIS: New Framework for Realistic Virtual Engineering , 2009, Concurr. Eng. Res. Appl..

[117]  George-Christopher Vosniakos,et al.  Structured design of flexibly automated manufacturing cells through semantic models and petri nets in a virtual reality environment , 2015 .

[118]  Nong Ye,et al.  Assembly Planning Effectiveness Using Virtual Reality , 1999, Presence: Teleoperators & Virtual Environments.

[119]  Ziying Tang,et al.  CAD-VR geometry and meta data synchronization for design review applications , 2006 .

[120]  Judy M. Vance,et al.  Virtual reality for assembly methods prototyping: a review , 2011, Virtual Reality.

[121]  S. J. Steiner,et al.  Virtual reality and augmented reality as a training tool for assembly tasks , 1999, 1999 IEEE International Conference on Information Visualization (Cat. No. PR00210).

[122]  Weiming Dong,et al.  Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry , 2011, VRCAI 2011.

[123]  Alain Bernard,et al.  Virtual hands and virtual reality multimodal platform to design safer industrial systems , 2007, Comput. Ind..

[124]  Mascha C. van der Voort,et al.  A new product design method based on virtual reality, gaming and scenarios , 2008 .

[125]  Xun Xu,et al.  Review: Virtual machine tools and virtual machining-A technological review , 2011 .

[126]  Jianyu Yang,et al.  Applications of virtual reality in turn-milling centre , 2008, 2008 IEEE International Conference on Automation and Logistics.

[127]  Judy M. Vance,et al.  Integrating operations simulation results with an immersive virtual reality environment , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[128]  Hyungjun Park,et al.  Design evaluation of digital consumer products using virtual reality-based functional behaviour simulation , 2008 .

[129]  Jing-Rong Li,et al.  Desktop virtual reality for maintenance training: an object oriented prototype system (V-REALISM) , 2003, Comput. Ind..

[130]  Martin R. Barnes.  Virtual reality and simulation , 1996, Winter Simulation Conference.

[131]  Ning Wang,et al.  Virtual Assembly, Maintenance and Training System Based on the Virtual - Real Fusion Technology , 2013, 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing.

[132]  Mustafa Alshawi,et al.  Construction industry offsite production: A virtual reality interactive training environment prototype , 2012, Adv. Eng. Informatics.

[133]  Johann Habakuk Israel,et al.  Towards hybrid modelling environments—Merging desktop-CAD and virtual reality-technologies , 2010 .

[134]  Ulrich Neumann,et al.  Cognitive, performance, and systems issues for augmented reality applications in manufacturing and maintenance , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[135]  Christian Weidig,et al.  VirCA NET: A case study for collaboration in shared virtual space , 2012, 2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom).

[136]  Joe Cecil,et al.  Virtual engineering approaches in product and process design , 2007 .

[137]  Chulho Chung,et al.  Enabled dynamic tasks planning in Web-based virtual manufacturing environments , 2008, Comput. Ind..

[138]  S. J. Steiner,et al.  Virtual Reality: A Tool for Assembly? , 2000, Presence: Teleoperators & Virtual Environments.

[139]  Andrew Y. C. Nee,et al.  Augmented reality applications in manufacturing: a survey , 2008 .

[140]  Tom Page,et al.  An investigation into the implementation of virtual reality technologies in support of conceptual design , 2006 .

[141]  Sotiris Makris,et al.  Automotive assembly technologies review: challenges and outlook for a flexible and adaptive approach , 2010 .

[142]  Rajit Gadh,et al.  Creation of concept shape designs via a virtual reality interface , 1997, Comput. Aided Des..

[143]  Chetan S. Shukla,et al.  Virtual manufacturing: an overview , 1996 .

[144]  Bijan Shirinzadeh,et al.  Virtual Factory for Manufacturing Process Visualization , 2004 .

[145]  Marcin Milanowicz,et al.  Designing a workplace for workers with motion disability with computer simulation and virtual reality techniques , 2011 .

[146]  Dimitris Mourtzis,et al.  Digital manufacturing: History, perspectives, and outlook , 2009 .

[147]  M.S.J. Hashmi,et al.  Virtual reality applications in manufacturing process simulation , 2004 .

[148]  Xiang Yang,et al.  Virtual reality enhanced manufacturing system design , 2011 .

[149]  Rajit Gadh,et al.  Multi-sensory user interface for a virtual-reality-based computer-aided design system , 1997, Comput. Aided Des..

[150]  Sarah Sharples,et al.  Virtual reality induced symptoms and effects (VRISE): Comparison of head mounted display (HMD), desktop and projection display systems , 2008, Displays.

[151]  Rade Tesic,et al.  Exact collision detection using virtual objects in virtual reality modeling of a manufacturing process , 1999 .

[152]  Joe Cecil,et al.  VREM: An advanced virtual environment for micro assembly , 2014 .

[153]  Philippe Fuchs,et al.  Applications of Virtual Reality in the manufacturing industry: from design review to ergonomic studies , 2004 .

[154]  John Simmons,et al.  Assembly planning in a virtual environment , 1997, Innovation in Technology Management. The Key to Global Leadership. PICMET '97.

[155]  Kevin W. Lyons,et al.  Virtual assembly using virtual reality techniques , 1997, Comput. Aided Des..

[156]  Janus S. Liang.  Generation of a virtual reality‐based automotive driving training system for CAD education , 2009, Comput. Appl. Eng. Educ..

[157]  Vincent G. Duffy,et al.  An Internet virtual reality collaborative environment for effective product design , 2001, Comput. Ind..

[158]  Bin Luo,et al.  Development an interactive VR training for CNC machining , 2004, VRCAI.

[159]  Gavriel Salvendy,et al.  Concurrent engineering and virtual reality for human resource planning , 2000 .