That's on my mind! robot to human intention communication through on-board projection on shared floor space

The upcoming new generation of autonomous vehicles for transporting materials in industrial environments will be more versatile, flexible and efficient than traditional AGVs, which simply follow pre-defined paths. However, freely navigating vehicles can appear unpredictable to human workers and thus cause stress and render joint use of the available space inefficient. Here we address this issue and propose on-board intention projection on the shared floor space for communication from robot to human. We present a research prototype of a robotic fork-lift equipped with a LED projector to visualize internal state information and intents. We describe the projector system and discuss calibration issues. The robot's ability to communicate its intentions is evaluated in realistic situations where test subjects meet the robotic forklift. The results show that already adding simple information, such as the trajectory and the space to be occupied by the robot in the near future, is able to effectively improve human response to the robot.

[1]  Klaus Schilling,et al.  A Spatial Augmented Reality system for intuitive display of robotic data , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[2]  Gerard Jounghyun Kim,et al.  Robots with projectors: An alternative to anthropomorphic HRI , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[3]  K. Upton,et al.  A modern approach , 1995 .

[4]  Mark J. Warshawsky,et al.  A Modern Approach , 2005 .

[5]  P. Maes,et al.  Old tricks, new dogs: ethology and interactive creatures , 1997 .

[6]  Yu Sun,et al.  Spatial augmented reality as a method for a mobile robot to communicate intended movement , 2014, Comput. Hum. Behav..

[7]  Stefan Kopp,et al.  An assistance system for guiding workers in central sterilization supply departments , 2013, PETRA '13.

[8]  Bruce A. MacDonald,et al.  Augmented reality visualisation for player , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[9]  Takafumi Matsumaru Mobile Robot with Preliminary-announcement and Display Function of Forthcoming Motion using Projection Equipment , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[10]  Nancy M. Amato,et al.  A Roadmap for US Robotics - From Internet to Robotics 2020 Edition , 2021, Found. Trends Robotics.

[11]  Brian Scassellati,et al.  Active vision for sociable robots , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[12]  Luca Maria Gambardella,et al.  Interactive Augmented Reality for understanding and analyzing multi-robot systems , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[14]  Kerstin Dautenhahn,et al.  Socially intelligent robots: dimensions of human–robot interaction , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[15]  Terrence Fong,et al.  VEVI: A Virtual Environment Teleoperations Interface for Planetary Exploration , 1995 .

[16]  Joo-Haeng Lee,et al.  A note on hybrid control of robotic spatial augmented reality , 2011, 2011 8th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[17]  Jari Saarinen,et al.  Fast, continuous state path smoothing to improve navigation accuracy , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[18]  David W. Payton,et al.  World embedded interfaces for human-robot interaction , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[19]  Robert Meyers,et al.  Real-time photorealistic virtualized reality interface for remote mobile robot control , 2010, ISRR.

[20]  Artur Arsenio,et al.  Augmented Reality behind the wheel - Human Interactive Assistance by Mobile Robots , 2015, 2015 6th International Conference on Automation, Robotics and Applications (ICARA).

[21]  Giovanni Muscato,et al.  3-D Integration of Robot Vision and Laser Data With Semiautomatic Calibration in Augmented Reality Stereoscopic Visual Interface , 2012, IEEE Transactions on Industrial Informatics.

[22]  Shumin Zhai,et al.  Applications of augmented reality for human-robot communication , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[23]  Joseph Bates,et al.  The role of emotion in believable agents , 1994, CACM.