Towards virtualized welding: Visualization and monitoring of remote welding

We present a new hybrid reality system that supports the monitoring and visualizing of a welding system. Our system first uses 3D scanning techniques to create a digital model of objects to be welded. Based on the model, a mock-up is constructed from a set of templates or 3D printed. The welding process is captured by cameras and visualized on the 3D mock-up using projectors. The welder can therefore monitor the welding process as if the welding is on the mock-up with proper spatial and 3D cues. An initial user performance evaluation of the system demonstrated several cognitive and performance benefits of the current implementation and suggests avenues for future research.

[1]  W Brent Seales,et al.  Hands-free administration of subjective workload scales: acceptability in a surgical training environment. , 2010, Applied ergonomics.

[2]  C. Choquet,et al.  ARC + ® : Today ’ s Virtual Reality Solution for Welders , 2008 .

[3]  Natasha Merat,et al.  Highly Automated Driving, Secondary Task Performance, and Driver State , 2012, Hum. Factors.

[4]  Samuel S. Silva,et al.  Head-mounted display versus desktop for 3D navigation in virtual reality: a user study , 2008, Multimedia Tools and Applications.

[5]  Greg Welch,et al.  Shader Lamps: Animating Real Objects With Image-Based Illumination , 2001, Rendering Techniques.

[6]  Thomas Alexander,et al.  The influence of different electronic maps and displays on performance and operator state in a geographic orientation task , 2011, Behav. Inf. Technol..

[7]  ZhangZhengyou A Flexible New Technique for Camera Calibration , 2000 .

[8]  Tal Oron-Gilad,et al.  Robotic Displays for Dismounted Warfighters , 2011 .

[9]  Jessie Y. C. Chen,et al.  Human Performance Issues and User Interface Design for Teleoperated Robots , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[10]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Gerd Hirzinger,et al.  Optimal Hand-Eye Calibration , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Mustapha Mouloua,et al.  Effects of Adaptive Task Allocation on Monitoring of Automated Systems , 1996, Hum. Factors.

[13]  Matthew Lamb,et al.  Viewpoint Tethering for Remotely Operated Vehicles: Effects on Complex Terrain Navigation and Spatial Awareness , 2011 .

[14]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[15]  P. Hancock,et al.  In search of vigilance: the problem of iatrogenically created psychological phenomena. , 2013, The American psychologist.

[16]  W. B. Seales,et al.  Assessing Mental Workload During Laparoscopic Surgery , 2005, Surgical innovation.

[17]  Byron J. Pierce,et al.  Perceptual Issues in the Use of Head-Mounted Visual Displays , 2006, Hum. Factors.