Enhancing 3D range image measurement density via dynamic Papoulis–Gerchberg algorithm

As one of the most popular range detection methods, lidar is commonly used in various robotic applications. Although most robotic platforms easily adopt 2D lidar for range sensing, 3D lidar is rarely used in mobile robots, owing to its high cost. Some methods reported in the literature obtain 3D range information by rotating a single 2D lidar device. However, for most of these methods, there is a trade-off between 3D scan frequency and measurement density. Existing methods discussed in the literature for increasing the measurement density in high-frequency lidar have high time complexity and require certain conditions on data distribution. In a previous work, we showed the usability of an image super-resolution method, the Papoulis–Gerchberg (P–G) algorithm, on range data represented in the form of a greyscale image. However, the low convergence rate of the original P–G algorithm impedes its use for online applications. In this study, we advanced the P–G algorithm to drastically reduce the convergence time and improve performance by utilizing previous range images. The proposed algorithm now supports application on a mobile robot with online measurement density enhancement for 3D range images collected by rotating a 2D lidar device around its pitch axis with a high 3D scan frequency. We show illustrative examples for different scenarios to present the effectiveness of the proposed method on a 3D range sensor mounted on a mobile robot.

[1]  Robert A. MacLachlan,et al.  Tracking Moving Objects From a Moving Vehicle Using a Laser Scanner , 2006 .

[2]  Shin'ichi Yuta,et al.  Development of ultra-small lightweight optical range sensor system , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Alexander Ferrein,et al.  Towards a Mobile Mapping Robot for Underground Mines , .

[4]  Nakju Lett Doh,et al.  Full-DOF Calibration of a Rotating 2-D LIDAR With a Simple Plane Measurement , 2016, IEEE Transactions on Robotics.

[5]  Huosheng Hu,et al.  Two-dimensional laser-based environment exploration and recognition for service robots , 2013 .

[6]  D.M. Bevly,et al.  Corridor navigation with a LiDAR/INS Kalman filter solution , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[7]  Michael Bosse,et al.  Zebedee: Design of a Spring-Mounted 3-D Range Sensor with Application to Mobile Mapping , 2012, IEEE Transactions on Robotics.

[8]  Christodoulos Chamzas,et al.  An improved version of Papoulis-Gerchberg algorithm on band-limited extrapolation , 1984 .

[9]  Alessandro Gardi,et al.  LIDAR Obstacle Warning and Avoidance System for Unmanned Aircraft , 2014 .

[10]  Mustafa Gul,et al.  A high frequency 3D LiDAR with enhanced measurement density via Papoulis-Gerchberg , 2015, 2015 International Conference on Advanced Robotics (ICAR).

[11]  W. Sardha Wijesoma,et al.  Road-boundary detection and tracking using ladar sensing , 2004, IEEE Transactions on Robotics and Automation.

[12]  J. Forbes Adaptive approaches to nonlinear state estimation for mobile robot localization: an experimental comparison , 2013 .

[13]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[14]  Ho Gi Jung,et al.  STEREO VISION-BASED FORWARD OBSTACLE DETECTION , 2007 .

[15]  Yoshitaka Hara,et al.  Development of small size 3D LIDAR , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Masamichi Shimosaka,et al.  Capturing device for dense point cloud of indoor people using horizontal LIDAR and pan rotation of vertical LIDAR with mirrors , 2012, 2012 IEEE/SICE International Symposium on System Integration (SII).

[17]  Marc Gallant,et al.  Two-Dimensional Axis Mapping Using LiDAR , 2016, IEEE Transactions on Robotics.

[18]  Ezzatollah Salari,et al.  Super-resolution using an enhanced Papoulis-Gerchberg algorithm , 2012 .

[19]  Joan Serrat,et al.  On-board image-based vehicle detection and tracking , 2011 .

[20]  Myoungho Sunwoo,et al.  Enhanced Road Boundary and Obstacle Detection Using a Downward-Looking LIDAR Sensor , 2012, IEEE Transactions on Vehicular Technology.

[21]  Luke Fletcher,et al.  A perception‐driven autonomous urban vehicle , 2008, J. Field Robotics.

[22]  Edwin Olson,et al.  A passive solution to the sensor synchronization problem , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Guna Seetharaman,et al.  Application Of Papoulis-Gerchberg Method In Image Super-Resolution and Inpainting , 2009, Comput. J..

[24]  Ben Weiss Fast median and bilateral filtering , 2006, SIGGRAPH 2006.

[25]  Joachim Hertzberg,et al.  A 3D laser range finder for autonomous mobile robots , 2001 .

[26]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[27]  Paulo Jorge S. G. Ferreira Interpolation and the discrete Papoulis-Gerchberg algorithm , 1994, IEEE Trans. Signal Process..

[28]  Yuli Sun,et al.  An iterative algorithm for computed tomography image reconstruction from limited-angle projections , 2013, ArXiv.

[29]  Nuno Borges Carvalho,et al.  Papoulis-Gerchberg Hybrid Filter Bank receiver for cognitive-/Software-Defined Radio systems , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[30]  Kazunori Ohno,et al.  Development of 3D laser scanner for measuring uniform and dense 3D shapes of static objects in dynamic environment. , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[31]  Paul E. Rybski,et al.  Obstacle Detection and Tracking for the Urban Challenge , 2009, IEEE Transactions on Intelligent Transportation Systems.

[32]  Larry H. Matthies,et al.  Stochastic performance, modeling and evaluation of obstacle detectability with imaging range sensors , 1994, IEEE Trans. Robotics Autom..

[33]  Luke Fletcher,et al.  A perception‐driven autonomous urban vehicle , 2008, J. Field Robotics.

[34]  Xu Wenyuan,et al.  On the Extrapolation of Band-Limited Functions with Energy Constraints , 1982 .

[35]  Zhi-Pei Liang,et al.  A New Algorithm in Spectral Analysis and Band-Limited Extrapolation , 2017 .

[36]  Lucas J. van Vliet,et al.  Separable bilateral filtering for fast video preprocessing , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[37]  Oliver Wulf,et al.  FAST 3 D SCANNING METHODS FOR LASER MEASUREMENT SYSTEMS , 2003 .

[38]  Xiaolei Yu,et al.  A novel low-altitude reconnaissance strategy for smart UAVs: active perception and chaotic navigation , 2011 .

[39]  Chau-Yun Hsu,et al.  Improved Papoulis-Gerchberg algorithm for restoring lost samples , 2005, Proceedings of the Fifth IEEE International Symposium on Signal Processing and Information Technology, 2005..

[40]  Cristiano Premebida,et al.  High-resolution LIDAR-based depth mapping using bilateral filter , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).