Advanced thermal camera based system for object detection on rail tracks

In this paper, an advanced thermal camera-based system for detection of objects on rail tracks is presented. Developed system is powered by advanced image processing algorithm, in order to achieve greater reliability and robustness, and tested on set of infrared images captured at night conditions. The goal of this system is to detect objects on rail tracks and next to them and estimate distances between camera stand and detected objects. For that purpose, different edge detection methods are tested, and finally Canny edge detector is selected for rail track detection and for determination of region of interest, further used for analysis in object detection process. In determined region of interest, region-based segmentation is used for object detection. For estimation of distances between camera stand and detected objects, homography based method is used. Validation of estimated distances is done, in respect to real measured distances from camera stand to objects (humans) involved in experiment. Distances are estimated with a maximum error of 2%. System can provide reliable object detection, as well as distance estimation, and for improved robustness and adaptability, artificial intelligence tools can be used.

[1]  A. Broggi,et al.  A multi-resolution approach for infrared vision-based pedestrian detection , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[2]  Massimo Bertozzi,et al.  Pedestrian detection by means of far-infrared stereo vision , 2007, Comput. Vis. Image Underst..

[3]  Antonio Fernández Caballero,et al.  Optical flow or image subtraction in human detection from infrared camera on mobile robot , 2010 .

[4]  Khan M. Iftekharuddin,et al.  Detection and tracking of targets in infrared images using Bayesian techniques , 2009 .

[5]  Toshiyuki Nakamiya,et al.  Robust Vehicle Detection under Various Environmental Conditions Using an Infrared Thermal Camera and Its Application to Road Traffic Flow Monitoring , 2012, Sensors.

[6]  T Ivan Ciric,et al.  INTELLIGENT OPTIMAL CONTROL OF THERMAL VISION-BASED PERSON-FOLLOWING ROBOT PLATFORM , 2014 .

[7]  Michael Felsberg,et al.  Detecting Rails and Obstacles Using a Train-Mounted Thermal Camera , 2015, SCIA.

[8]  Hamid Hassanpour,et al.  Edge Detection Techniques: Evaluations and Comparison , 2008 .

[9]  Zarko Cojbasic,et al.  Computationally intelligent system for thermal vision people detection and tracking in robotic applications , 2013, 2013 11th International Conference on Telecommunications in Modern Satellite, Cable and Broadcasting Services (TELSIKS).

[10]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[11]  Tinku Acharya,et al.  Image Processing: Principles and Applications , 2005, J. Electronic Imaging.

[12]  T Ivan Ciric,et al.  Thermal vision based intelligent system for human detection and tracking in mobile robot control system , 2016 .

[13]  Michael Arens,et al.  Feature based person detection beyond the visible spectrum , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[14]  Weihong Wang,et al.  Improved human detection and classification in thermal images , 2010, 2010 IEEE International Conference on Image Processing.