Vision-Based Indoor Localization Using Artificial Landmarks and Natural Features on the Ceiling with Optical Flow and a Kalman Filter

This paper proposes a vision-based indoor localization method for autonomous vehicles. A single upward-facing digital camera was mounted on an autonomous vehicle and used as a vision sensor to identify artificial landmarks and any natural corner features. An interest point detector was used to find the natural features. Using an optical flow detection algorithm, information related to the direction and vehicle translation was defined. This information was used to track the vehicle movements. Random noise related to uneven light disrupted the calculation of the vehicle translation. Thus, to estimate the vehicle translation, a Kalman filter was used to calculate the vehicle position. These algorithms were tested on a vehicle in a real environment. The image processing method could recognize the landmarks precisely, while the Kalman filter algorithm could estimate the vehicle’s position accurately. The experimental results confirmed that the proposed approaches can be implemented in practical situations.

[1]  De Xu,et al.  Ceiling-Based Visual Positioning for an Indoor Mobile Robot With Monocular Vision , 2009, IEEE Transactions on Industrial Electronics.

[2]  Hyukmin Eum,et al.  Vision Sensor-Based Driving Algorithm for Indoor Automatic Guided Vehicles , 2013, Int. J. Fuzzy Log. Intell. Syst..

[3]  Hyungsuck Cho,et al.  An active trinocular vision system of sensing indoor navigation environment for mobile robots , 2006 .

[4]  Hyun Myung,et al.  Mobile robot localization with gyroscope and constrained Kalman filter , 2010 .

[5]  Sungshin Kim,et al.  Implementation of real-time positioning system using extended Kalman filter and artificial landmark on ceiling , 2012 .

[6]  Hideki Hashimoto,et al.  Appearance Based Object Identification for Mobile Robot Localization in Intelligent Space with Distributed Vision Sensors , 2004, Int. J. Fuzzy Log. Intell. Syst..

[7]  Giovanni Ulivi,et al.  A Low Cost Vision Based Localization System for Mobile Robots , 2001 .

[8]  Keum-Shik Hong,et al.  A tracking algorithm for autonomous navigation of AGVs in an automated container terminal , 2005 .

[9]  Fumihito Arai,et al.  Navigation system based on ceiling landmark recognition for autonomous mobile robot-landmark detection based on fuzzy template matching (FTM) , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[10]  Youngjoon Han,et al.  Balance control of a biped robot using camera image of reference object , 2009 .

[11]  Jong-Seo Park,et al.  Some Common Fixed Points for Type(β) Compatible Maps in an Intuitionistic Fuzzy Metric Space , 2013, Int. J. Fuzzy Log. Intell. Syst..

[12]  Sungshin Kim,et al.  Modeling of vision based robot formation control using fuzzy logic controller and extended Kalman filter , 2012, Int. J. Fuzzy Log. Intell. Syst..

[13]  Wen-Hsiang Tsai,et al.  Robotics and Autonomous Systems Location Estimation for Indoor Autonomous Vehicle Navigation by Omni-directional Vision Using Circular Landmarks on Ceilings , 2022 .

[14]  Jae-Bok Song,et al.  Mobile robot localization based on effective combination of vision and range sensors , 2009 .

[15]  Emanuele Menegatti,et al.  Image-based memory for robot navigation using properties of omnidirectional images , 2004, Robotics Auton. Syst..

[16]  Kyoung Mu Lee,et al.  CV-SLAM: a new ceiling vision-based SLAM technique , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.