Third Point of View Augmented Reality for Robot Intentions Visualization

Lightweight, head-up displays integrated in industrial helmets allow to provide contextual information for industrial scenarios such as in maintenance. Moving from single display and single camera solutions to stereo perception and display opens new interaction possibilities. In particular this paper addresses the case of information sharing by a Baxter robot displayed to the user overlooking at the real scene. System design and interaction ideas are being presented.

[1]  Carlo Alberto Avizzano,et al.  Co-located haptic interaction for virtual USG exploration , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[2]  Ravi Teja Chadalavada,et al.  That's on my mind! robot to human intention communication through on-board projection on shared floor space , 2015, 2015 European Conference on Mobile Robots (ECMR).

[3]  E. Guizzo,et al.  The rise of the robot worker , 2012, IEEE Spectrum.

[4]  Weidong Huang,et al.  HandsIn3D: Supporting Remote Guidance with Immersive Virtual Environments , 2013, INTERACT.

[5]  Francisco José Madrid-Cuevas,et al.  Automatic generation and detection of highly reliable fiducial markers under occlusion , 2014, Pattern Recognit..

[6]  Carlo Alberto Avizzano,et al.  Augmented reality-aided tele-presence system for robot manipulation in industrial manufacturing , 2015, VRST.

[7]  Alex Olwal,et al.  Spatial augmented reality on industrial CNC-machines , 2008, Electronic Imaging.

[8]  Holger Regenbrecht,et al.  Augmented reality projects in the automotive and aerospace industries , 2005, IEEE Computer Graphics and Applications.

[9]  Emanuele Ruffaldi,et al.  CoCo - A Framework for Multicore Visuo-Haptics in Mixed Reality , 2016, AVR.

[10]  Michael F. Zäh,et al.  Interactive laser-projection for programming industrial robots , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[11]  John C. Tang,et al.  3D Collaboration Method over HoloLens™ and Skype™ End Points , 2015, ImmersiveME@ACM Multimedia.

[12]  Clint Heyer.  Human-robot interaction and future industrial robotics applications , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Nikolaos Mavridis,et al.  A review of verbal and non-verbal human-robot interactive communication , 2014, Robotics Auton. Syst..

[14]  Ruffaldi Emanuele,et al.  Co-located haptic interaction for virtual USG exploration , 2015, EMBC 2015.

[15]  Vincent Lepetit,et al.  Multimodal templates for real-time detection of texture-less objects in heavily cluttered scenes , 2011, 2011 International Conference on Computer Vision.