A QR-code localization system for mobile robots: Application to smart wheelchairs

A Smart Wheelchair (SW) is an electric powered wheelchair, equipped with sensors and computational capabilities, with the general aim of both enhancing independence and improving perceived quality of life of the impaired people using it. SWs belong to the class of semi-autonomous mobile robots, designed to carry the user from one location to another of his/her choice. For such systems, the localization aspect is of utmost concern, since GPS signal is not available indoors and alternative sensor sets are required. This paper proposes a low- cost artificial landmark-based localization system for mobile robots operating indoor. It is based on Quick Response (QR) codes, which contain the absolute position of the landmark: a vision system recognizes the codes, estimates the relative position of the robot (i.e., displacement and orientation) w.r.t. the codes and, finally, calculates the absolute position of the robot by exploiting the information contained in the codes. The system has been experimentally validated for self-localization of a smart wheelchair, and experimental results confirm that navigation is possible when considering an high QR-code density, while QR-code low density conditions permit to reset the cumulative odometry error.

[1]  Sauro Longhi,et al.  SLAM-based autonomous wheelchair navigation system for AAL scenarios , 2014, 2014 IEEE/ASME 10th International Conference on Mechatronic and Embedded Systems and Applications (MESA).

[2]  R.C. Simpson,et al.  The Hephaestus Smart Wheelchair system , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  T Leo,et al.  A navigation system for increasing the autonomy and the security of powered wheelchairs. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[4]  Don Joven Agravante,et al.  Visual servoing for the REEM humanoid robot's upper body , 2013, 2013 IEEE International Conference on Robotics and Automation.

[5]  H. Kobayashi,et al.  A new proposal for self-localization of mobile robot by self-contained 2D barcode landmark , 2012, 2012 Proceedings of SICE Annual Conference (SICE).

[6]  Gianluca Ippoliti,et al.  A Multiple Models Approach for Adaptation and Learning in Mobile Robots Control , 2006, J. Intell. Robotic Syst..

[7]  Sauro Longhi,et al.  AAL Technologies for Independent Life of Elderly People , 2015 .

[8]  Marta Rostkowska,et al.  On the Application of QR Codes for Robust Self-localization of Mobile Robots in Various Application Scenarios , 2015, Progress in Automation, Robotics and Measuring Techniques.

[9]  Hui Zhang,et al.  Landmark-Based Localization for Indoor Mobile Robots with Stereo Vision , 2012, 2012 Second International Conference on Intelligent System Design and Engineering Application.

[10]  Éric Marchand,et al.  ViSP for visual servoing: a generic software platform with a wide class of robot control skills , 2005, IEEE Robotics & Automation Magazine.

[11]  R.C. Luo,et al.  Indoor autonomous mobile robot localization using natural landmark , 2008, 2008 34th Annual Conference of IEEE Industrial Electronics.

[12]  Wei Yang,et al.  Localization and navigation using QR code for mobile robot in indoor environment , 2015, 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[13]  Guy Bourhis,et al.  Driving Assistance by Deictic Control for a Smart Wheelchair: The Assessment Issue , 2014, IEEE Transactions on Human-Machine Systems.

[14]  Valeri Kroumov,et al.  Localization and position correction for mobile robot using artificial visual landmarks , 2011, The 2011 International Conference on Advanced Mechatronic Systems.

[15]  A. Cappozzo,et al.  Human movement analysis using stereophotogrammetry. Part 2: instrumental errors. , 2004, Gait & posture.

[16]  In-So Kweon,et al.  Metric localization using a single artificial landmark for indoor mobile robots , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Sauro Longhi,et al.  A coordination architecture for UUV fleets , 2012, Intell. Serv. Robotics.

[18]  Roland Siegwart,et al.  Introduction to Autonomous Mobile Robots , 2004 .

[19]  Hyun Myung,et al.  Experimental Validation of Visually Servoed Paired Structured Light System (ViSP) for Structural Displacement Monitoring , 2014, IEEE/ASME Transactions on Mechatronics.

[20]  Maysam Ghovanloo,et al.  Evaluation of a Smartphone Platform as a Wireless Interface Between Tongue Drive System and Electric-Powered Wheelchairs , 2012, IEEE Transactions on Biomedical Engineering.

[21]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[22]  Sauro Longhi,et al.  Localization of mobile robots: Development and comparative evaluation of algorithms based on odometric and inertial sensors , 2005, J. Field Robotics.

[23]  Jaerock Kwon,et al.  QR-code based Localization for Indoor Mobile Robot with validation using a 3D optical tracking instrument , 2015, 2015 IEEE International Conference on Advanced Intelligent Mechatronics (AIM).

[24]  Adam Herout,et al.  Fast detection and recognition of QR codes in high-resolution images , 2013, SCCG.

[25]  Monteriu Andrea,et al.  An Inertial and QR Code Landmarks-Based Navigation System for Impaired Wheelchair Users , 2014 .

[26]  Sauro Longhi,et al.  Probabilistic Self-Localization and Mapping - An Asynchronous Multirate Approach , 2008, IEEE Robotics & Automation Magazine.