Augmented Reality behind the wheel - Human Interactive Assistance by Mobile Robots

Novel approaches have taken Augmented Reality (AR) beyond traditional body-worn or hand-held displays, leading to the creation of a new branch of AR: Spatial Augmented Reality (SAR) providing additional application areas. SAR is a rapidly emerging field that uses digital projectors to render virtual objects onto 3D objects in the real space. When mounting digital projectors on robots, this collaboration paves the way for unique Human-Robot Interactions (HRI) that otherwise would not be possible. Adding to robots the capability of projecting interactive Augmented Reality content enables new forms of interactions between humans, robots, and virtual objects, enabling new applications. In this work it is investigated the use of SAR techniques on mobile robots for better enabling this to interact in the future with elderly or injured people during rehabilitation, or with children in the pediatric ward of a hospital.

[1]  Ramesh Raskar,et al.  Cartoon dioramas in motion , 2002, NPAR '02.

[2]  Ramesh Raskar,et al.  Dynamic shader lamps : painting on movable objects , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[3]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[4]  Peter Schröder,et al.  Surface drawing: creating organic 3D shapes with the hand and tangible tools , 2001, CHI.

[5]  Weipeng Liu,et al.  People-following system design for mobile robots using kinect sensor , 2013, 2013 25th Chinese Control and Decision Conference (CCDC).

[6]  Chris Harris,et al.  Tracking with rigid models , 1993 .

[7]  N. Hurtós,et al.  Plane-based calibration of a projector-camera system , 2008 .

[8]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[9]  Pattie Maes,et al.  LuminAR: portable robotic augmented reality interface design and prototype , 2010, UIST '10.

[10]  Ramesh Raskar,et al.  Cartoon dioramas in motion , 2005, SIGGRAPH Courses.

[11]  Hrvoje Benko,et al.  Combining multiple depth cameras and projectors for interactions on, above and between surfaces , 2010, UIST.

[12]  Michael A. Goodrich,et al.  Human-Robot Interaction: A Survey , 2008, Found. Trends Hum. Comput. Interact..

[13]  Gwi-Tae Park,et al.  Anamorphosis Projection by Ubiquitous Display in Intelligent Space , 2009, HCI.

[14]  Hee-kyoung Jung,et al.  Spray Modeling: Augmented Reality Based 3D Modeling Interface for Intuitive and Evolutionary Form Development , 2004 .

[15]  Ruigang Yang,et al.  PixelFlex: a reconfigurable multi-projector display system , 2001, Proceedings Visualization, 2001. VIS '01..