Vision based localization under dynamic illumination

Localization in dynamically illuminated environments is often difficult due to static objects casting dynamic shadows. Feature extraction algorithms may detect both the objects and their shadows, producing conflict in localization algorithms. This work examines a colour model that separates brightness from chromaticity and applies it to eliminate features caused by dynamic illumination. The colour model is applied in two novel ways. Firstly, the chromaticity distortion of a single feature is used to determine if the feature is the result of illumination alone i.e. a shadow. Secondly, the chromaticity distortion of features matched between images is examined to determine if the monochrome based algorithm has matched them correctly. These two applications are put through a variety of tests in simulated then real world environments to assess their effectiveness in dynamically illuminated scenarios. The results demonstrate a significant reduction in the number of feature mismatches between images with dynamic light sources. The evaluation of the techniques individually in a Simultaneous Localization and Mapping (SLAM) task show substantial improvements in accuracy, with the combination of the two techniques producing a localization result that is highly robust to the environmental lighting.

[1]  Andrew Jarosz,et al.  An Inspection and Surveying System For Vertical Shafts , 2009, ICRA 2009.

[2]  Javier Civera,et al.  1‐Point RANSAC for extended Kalman filtering: Application to real‐time structure from motion and visual odometry , 2010, J. Field Robotics.

[3]  Arnold W. M. Smeulders,et al.  Color Invariance , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Aly A. Farag,et al.  CSIFT: A SIFT Descriptor with Color Invariant Characteristics , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[5]  Gertjan J. Burghouts,et al.  Performance evaluation of local colour invariants , 2009, Comput. Vis. Image Underst..

[6]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[7]  Wolfram Burgard,et al.  Robust vision-based localization by combining an image-retrieval system with Monte Carlo localization , 2005, IEEE Transactions on Robotics.

[8]  Horst Bischof,et al.  Illumination Insensitive Robot Self-Localization Using Panoramic Eigenspaces , 2004, RoboCup.

[9]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[10]  James J. Little,et al.  Vision-based mobile robot localization and mapping using scale-invariant features , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[11]  Javier Civera,et al.  1-Point RANSAC for extended Kalman filtering: Application to real-time structure from motion and visual odometry , 2010 .

[12]  Wan Kyun Chung,et al.  A practical approach for EKF-SLAM in an indoor environment: fusing ultrasonic sensors and stereo camera , 2008, Auton. Robots.

[13]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[14]  Kostas Daniilidis,et al.  Monocular visual odometry in urban environments using an omnidirectional camera , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Horst Bischof,et al.  Illumination insensitive recognition using eigenspaces , 2004, Comput. Vis. Image Underst..

[16]  Brian V. Funt,et al.  Color Angular Indexing , 1996, ECCV.

[17]  정완균,et al.  Metric SLAM in Home Environment with Visual Objects and Sonar Features , 2006 .

[18]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[20]  Larry S. Davis,et al.  A Robust Background Subtraction and Shadow Detection , 1999 .

[21]  Michel Dhome,et al.  Generic and real-time structure from motion using local bundle adjustment , 2009, Image Vis. Comput..

[22]  Patrick Rives,et al.  An Efficient Direct Approach to Visual SLAM , 2008, IEEE Transactions on Robotics.

[23]  Walterio W. Mayol-Cuevas,et al.  Robust Real-Time Visual SLAM Using Scale Prediction and Exemplar Based Feature Description , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Andreas Zell,et al.  Localization of mobile robots with omnidirectional vision using Particle Filter and iterative SIFT , 2006, Robotics Auton. Syst..

[25]  Andrew Jarosz.  Development of inspection system for evaluation of ore-passes at Grasberg Mine, PT Freeport, Indonesia , 2008 .

[26]  A. Davison,et al.  1-Point RANSAC for EKF Filtering . Application to Real-Time Structure from Motion and Visual Odometry , 2010 .

[27]  Matthew A. Brown,et al.  Invariant Features from Interest Point Groups , 2002, BMVC.

[28]  Geraldo F. Silveira,et al.  Real-time Visual Tracking under Arbitrary Illumination Changes , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.