Hardware-Efficient Image-Based Robotic Path Planning in a Dynamic Environment and Its FPGA Implementation

This paper presents a hardware-efficient algorithm and a very large scale integration architecture for finding a path for a mobile robot on the image of an environment captured by an overhead camera. The algorithm computes a distance map to identify the collision-free region for the robot and then constructs a breadth-first search tree to find a path in that region. The path obtained from a start point to the goal is the shortest path in terms of the number of steps. The time-critical part of the algorithm is mapped onto a 2-D cellular architecture that consists of a locally interconnected array of identical processing elements. In view of this local interconnection and regular structure, the architecture can be operated at high speed. An extension based on the assignment of multiple pixels to a processing element and processing them in pipeline is proposed to enhance the scalability of the design. The design has been implemented and evaluated on a Xilinx ML403 evaluation platform with Virtex-4 XC4VFX12 field-programmable gate array (FPGA). The maximum frequency of operation obtained is 375 MHz. This results in computing a collision-free path on images of size 100 × 100 in less than 27.6 μs. The FPGA design is capable of processing images at video rate for real-time path planning in a dynamic environment.

[1]  K. Sridharan,et al.  Cellular architecture for euclidean distance transformation , 2000 .

[2]  Takayuki Kanda,et al.  Abstracting People's Trajectories for Social Robots to Proactively Approach Customers , 2009, IEEE Transactions on Robotics.

[3]  Samir Palnitkar,et al.  Verilog HDL: a guide to digital design and synthesis , 1996 .

[4]  Z. Zenn Bien,et al.  A Steward Robot for Human-Friendly Human-Machine Interaction in a Smart House Environment , 2008, IEEE Transactions on Automation Science and Engineering.

[5]  N. Sudha,et al.  Design of a hardware accelerator for path planning on the Euclidean distance transform , 2008, J. Syst. Archit..

[6]  Avinash C. Kak,et al.  Vision for Mobile Robot Navigation: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Ramakant Nevatia,et al.  Representation and computation of the spatial environment for indoor navigation , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Pedro Sánchez-Palma,et al.  Design of service robots , 2009, IEEE Robotics & Automation Magazine.

[9]  Ali Shokoufandeh,et al.  Landmark Selection for Vision-Based Navigation , 2006, IEEE Trans. Robotics.

[10]  Eric Monmasson,et al.  FPGA Design Methodology for Industrial Control Systems—A Review , 2007, IEEE Transactions on Industrial Electronics.

[11]  Huosheng Hu,et al.  Multisensor-Based Human Detection and Tracking for Mobile Service Robots , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Ren C. Luo,et al.  Autonomous mobile robot global motion planning and geometric beacon collection using traversability vectors , 1997, IEEE Trans. Robotics Autom..

[13]  Howie Choset,et al.  Principles of Robot Motion: Theory, Algorithms, and Implementation ERRATA!!!! 1 , 2007 .

[14]  Ernst Dieter Dickmanns Computer Vision and Highway Automation , 1999 .

[15]  K. Sridharan,et al.  A high-speed VLSI design and ASIC implementation for constructing Euclidean distance-based discrete Voronoi diagram , 2004, IEEE Transactions on Robotics and Automation.

[16]  K. Sridharan,et al.  Hardware-efficient schemes for logarithmic approximation and binary search with application to visibility graph construction , 2004, IEEE Transactions on Industrial Electronics.

[17]  Dezhen Song,et al.  Vision-based motion planning for an autonomous motorcycle on ill-structured roads , 2007, Auton. Robots.

[18]  Gérard G. Medioni,et al.  Robust real-time vision for a personal service robot , 2007, Comput. Vis. Image Underst..

[19]  Woojin Chung,et al.  Discrete-Status-Based Localization for Indoor Service Robots , 2006, IEEE Transactions on Industrial Electronics.

[20]  Sooyong Park,et al.  Service robot for the elderly , 2009, IEEE Robotics & Automation Magazine.

[21]  Wen-Hsiang Tsai,et al.  Vision-based autonomous land vehicle guidance in outdoor road environments using combined line and road following techniques , 1997 .

[22]  K. Sridharan,et al.  The design of a hardware accelerator for real-time complete visibility graph construction and efficient FPGA implementation , 2005, IEEE Transactions on Industrial Electronics.

[23]  K. Sridharan,et al.  Hardware-Efficient Prediction-Correction-Based Generalized-Voronoi-Diagram Construction and FPGA Implementation , 2008, IEEE Transactions on Industrial Electronics.

[24]  Scott E. Umbaugh,et al.  Computer Vision and Image Processing: A Practical Approach Using CVIPTools , 1997 .

[25]  Panagiotis Tzionas,et al.  Collision-free path planning for a diamond-shaped robot using two-dimensional cellular automata , 1997, IEEE Trans. Robotics Autom..

[26]  Jagath Samarabandu,et al.  Robust and Efficient Feature Tracking for Indoor Navigation , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[27]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.

[28]  Horst-Michael Groß,et al.  Vision-based Monte Carlo self-localization for a mobile service robot acting as shopping assistant in a home store , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  María José Moure,et al.  Features, Design Tools, and Application Domains of FPGAs , 2007, IEEE Transactions on Industrial Electronics.

[30]  Todd Jochem,et al.  Rapidly Adapting Machine Vision for Automated Vehicle Steering , 1996, IEEE Expert.

[31]  Vijay Kumar,et al.  Integrating Human Inputs with Autonomous Behaviors on an Intelligent Wheelchair Platform , 2007, IEEE Intelligent Systems.

[32]  Liyanage C. De Silva,et al.  Multimodal Approach to Human-Face Detection and Tracking , 2008, IEEE Transactions on Industrial Electronics.

[33]  K. Sridharan,et al.  A hardware-efficient scheme and FPGA realization for computation of single pair shortest path for a mobile automaton , 2006, Microprocess. Microsystems.

[34]  Heesung Jun,et al.  Vision-based location positioning using augmented reality for indoor navigation , 2008, IEEE Transactions on Consumer Electronics.