Haptic and visual augmented reality interface for programming welding robots

It is a challenging task for operators to program a remote robot for welding manipulation depending only on the visual information from the remote site. This paper proposes an intuitive user interface for programming welding robots remotely using augmented reality (AR) with haptic feedback. The proposed system uses a depth camera to reconstruct the surfaces of workpieces. A haptic input device is used to allow users to define welding paths along these surfaces. An AR user interface is developed to allow users to visualize and adjust the orientation of the welding torch. Compared with the traditional robotic welding path programming methods which rely on prior CAD models or contact between the robot end-effector and the workpiece, this proposed approach allows for fast and intuitive remote robotic welding path programming without prior knowledge of CAD models of the workpieces. The experimental results show that the proposed approach is a user-friendly interface and can assist users in obtaining an accurate welding path.

[1]  El Saddik,et al.  The Potential of Haptics Technologies , 2007, IEEE Instrumentation & Measurement Magazine.

[2]  Yizhong Wang,et al.  Study on Welder Training by Means of Haptic Guidance and Virtual Reality for Arc Welding , 2006, ROBIO.

[3]  Russell H. Taylor,et al.  Telerobotic Control by Virtual Fixtures for Surgical Applications , 2007, Advances in Telerobotics.

[4]  Costas S. Tzafestas,et al.  Human telehaptic perception of stiffness using an adaptive impedance reflection bilateral teleoperation control scheme , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[5]  Peter Kazanzides,et al.  Model-based telerobotic control with virtual fixtures for satellite servicing tasks , 2013, 2013 IEEE International Conference on Robotics and Automation.

[6]  . P.AbhijithReddy.  DESIGN AND DEVELOPMENT OF A TELEMANIPULATED WELDING ROBOT WITH VISUAL AND HAPTIC FEEDBACK , 2016 .

[7]  George Chryssolouris,et al.  A prototype virtual reality-based demonstrator for immersive and interactive simulation of welding processes , 2006, Int. J. Comput. Integr. Manuf..

[8]  John Kenneth Salisbury,et al.  Point clouds can be represented as implicit surfaces for constraint-based haptic rendering , 2012, 2012 IEEE International Conference on Robotics and Automation.

[9]  Aude Bolopion,et al.  A Review of Haptic Feedback Teleoperation Systems for Micromanipulation and Microassembly , 2013, IEEE Transactions on Automation Science and Engineering.

[10]  Sotiris Makris,et al.  Augmented reality system for operator support in human–robot collaborative assembly , 2016 .

[11]  Stefano Caselli,et al.  Evaluation of virtual fixtures for a robot programming by demonstration interface , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[12]  Louis B. Rosenberg,et al.  Virtual fixtures: Perceptual tools for telerobotic manipulation , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[13]  George Chryssolouris,et al.  Using VR for Complex Product Design , 2014, HCI.

[14]  Francisco José Madrid-Cuevas,et al.  Automatic generation and detection of highly reliable fiducial markers under occlusion , 2014, Pattern Recognit..

[15]  Dalong Wang,et al.  A HAPTIC BASE HUMAN ROBOT INTERACTION APPROACH FOR ROBOTIC GRIT BLASTING , 2008 .

[16]  Nils Andersson,et al.  AR-Enhanced Human-Robot-Interaction - Methodologies, Algorithms, Tools , 2016 .

[17]  T. Oikawa,et al.  A method for supporting robot's actions using virtual reality in a smart space , 2006, 2006 SICE-ICASE International Joint Conference.

[18]  Milos Manic,et al.  Video game device haptic interface for robotic arc welding , 2009, 2009 2nd Conference on Human System Interactions.