Virtual reality in manufacturing: immersive and collaborative artificial-reality in design of human-robot workspace

ABSTRACT Over the past years, the concept of human-machine interaction has received ample attention to achieve hybrid automation in manufacturing. A form of hybrid automation is taking benefit from the synergistic effect of human-robot collaboration. When used in assembly, the requirement of flexibility, adaptability and safety makes the design and redesign of human-robot collaborative (HRC) systems a complex and prone to error process. The use of time-based continuous simulations can offer safe virtual space for testing and validation thus easing the design of complex HRC systems. However, conventional simulations don’t allow to experience the future production system as an end-user in an immersive environment. This paper explores the technological development in virtual reality (VR) for design of human-centred production systems and develops a unified framework to integrate human-robot simulation with VR. The simulation as an event-driven simulation helped in estimating the human-robot cycle times, developing process-plan, layout optimisation and robot control program. The same simulation is used in VR to interact with the production equipment and particularly with the robot. Additionally, AWS Sumerian environment is used to create a virtual robot to assist VR user in the design process.

[1]  Jörg Krüger,et al.  Human-Centred Automation to Simplify the Path to Social and Economic Sustainability , 2017 .

[2]  Jochen Deuse,et al.  Intuitive Work Assistance by Reciprocal Human-robot Interaction in the Subject Area of Direct Human-robot Collaboration☆ , 2016 .

[3]  Arne Bilberg,et al.  Adaptable and Reconfigurable LEAN Automation - a competitive solution in the western industry , 2012 .

[4]  Michael W. Grieves.  Virtually Intelligent Product Systems: Digital and Physical Twins , 2019, Complex Systems Engineering: Theory and Practice.

[5]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[6]  Sotiris Makris,et al.  On a human–robot workplace design and task allocation system , 2017, Int. J. Comput. Integr. Manuf..

[7]  W. Kuehn.  DIGITAL FACTORY – INTEGRATION OF SIMULATION ENHANCING THE PRODUCT AND PRODUCTION PROCESS TOWARDS OPERATIVE CONTROL AND OPTIMISATION , 2006 .

[8]  Gabriel Zachmann,et al.  HIPS - A Virtual Reality Hip Prosthesis Implantation Simulator , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[9]  T. Masood,et al.  Augmented reality in support of Industry 4.0 - Implementation challenges and success factors , 2019, Robotics Comput. Integr. Manuf..

[10]  George Chryssolouris,et al.  Assembly system design and operations for product variety , 2011 .

[11]  Arne Bilberg,et al.  Framework to Implement Collaborative Robots in Manual Assembly: A Lean Automation Approach , 2017 .

[12]  Dieter Kranzlmuller,et al.  State of the art of virtual reality technology , 2016, 2016 IEEE Aerospace Conference.

[13]  Frank Flemisch,et al.  Towards a dynamic balance between humans and automation: authority, ability, responsibility and control in shared and cooperative control situations , 2012, Cognition, Technology & Work.

[14]  Arne Bilberg,et al.  Human centered Lean automation in assembly , 2019, Procedia CIRP.

[15]  Beata Mrugalska,et al.  Towards Lean Production in Industry 4.0 , 2017 .

[16]  Markus König,et al.  Low-cost virtual reality environment for engineering and construction , 2015 .

[17]  Arne Bilberg,et al.  When simulation takes control , 1991 .

[18]  B. Scassellati,et al.  Challenges in Shared-Environment Human-Robot Collaboration , 2013 .

[19]  Bilge Mutlu,et al.  Understanding human-robot interaction in virtual reality , 2017, 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[20]  Tobias Greitemeyer,et al.  The impact of immersion on the perception of pornography: A virtual reality study , 2019, Comput. Hum. Behav..

[21]  Tariq Masood,et al.  Adopting augmented reality in the age of industrial digitalisation , 2020, Comput. Ind..

[22]  Giuseppe Di Gironimo,et al.  Implementation of tactile sensors on a 3-Fingers Robotiq® adaptive gripper and visualization in VR using Arduino controller , 2018 .

[23]  Sotiris Makris,et al.  Workplace analysis and design using virtual reality techniques , 2018 .

[24]  Sotiris Makris,et al.  Human–robot interaction review and challenges on task planning and programming , 2016, Int. J. Comput. Integr. Manuf..

[25]  Yoseph Bar-Cohen,et al.  Haptic Devices for Virtual Reality, Telepresence, and Human-Assistive Robotics , 2003 .

[26]  Sotiris Makris,et al.  The role of simulation in digital manufacturing: applications and outlook , 2015, Int. J. Comput. Integr. Manuf..

[27]  Charles E. Billings,et al.  Aviation Automation: The Search for A Human-centered Approach , 1996 .

[28]  Arne Bilberg,et al.  Digital twin driven human–robot collaborative assembly , 2019, CIRP Annals.

[29]  Wen Yi,et al.  A critical review of virtual and augmented reality (VR/AR) applications in construction safety , 2018 .

[30]  Shozo Takata,et al.  Human and robot allocation method for hybrid assembly systems , 2011 .

[31]  Arne Bilberg,et al.  Complexity-based task allocation in human-robot collaborative assembly , 2019, Ind. Robot.

[32]  Gunther Reinhart,et al.  Cyber-Physical-Robotics – Modelling of modular robot cells for automated planning and execution of assembly tasks , 2016 .

[33]  Malte Brettel,et al.  How Virtualization, Decentralization and Network Building Change the Manufacturing Landscape: An Industry 4.0 Perspective , 2014 .

[34]  Muhanna Muhanna,et al.  Virtual reality and the CAVE: Taxonomy, interaction challenges and research directions , 2015, J. King Saud Univ. Comput. Inf. Sci..

[35]  B Korves,et al.  The application of immersive virtual reality for layout planning of manufacturing cells , 1999 .

[36]  George Chryssolouris,et al.  Design and simulation of assembly systems with mobile robots , 2014 .

[37]  Jeremy L. Rickli,et al.  A Framework for Collaborative Robot (CoBot) Integration in Advanced Manufacturing Systems , 2016 .

[38]  Arne Bilberg,et al.  Digital twins of human robot collaboration in a production setting , 2018 .

[39]  Alexander Brem,et al.  Augmented Reality Smart Glasses : Definition , Conceptual Insights , and Managerial Importance 1 , 2017 .

[40]  Magnus Wiktorsson,et al.  Method for Design of Human-industrial Robot Collaboration Workstations , 2017 .

[41]  Johan Eriksson,et al.  Virtual reality commissioning in production systems preparation , 2017, 2017 22nd IEEE International Conference on Emerging Technologies and Factory Automation (ETFA).

[42]  Rainer Müller,et al.  Robot Workmate: A Trustworthy Coworker for the Continuous Automotive Assembly Line and its Implementation☆ , 2016 .

[43]  Anna Granlund,et al.  Lean Automation: Requirements and Solutions for Efficient use of Robot Automation in the Swedish Manufacturing Industry , 2011 .

[44]  Mauro Onori,et al.  Human-machine Collaboration in Virtual Reality for Adaptive Production Engineering , 2017 .

[45]  Ellen Yi-Luen Do,et al.  The Sensation of Taste in the Future of Immersive Media , 2014, ImmersiveMe '14.

[46]  Amit Agrawal.  Putting VR/AR to Work , 2018, IEEE Computer Graphics and Applications.