Very low power parallel implementation of stereo vision algorithm on a solar cell powered MIMD many core architecture

We present wavefront/systolic algorithms for efficient implementation of Stereo Vision (SV) computation on a novel and very low power many core MIMD architecture, the IntellaSys S40C18. 12For Sum of Squared Differences (SSD) and Sum of Absolute Differences (SAD) SV algorithms with a disparity range of 16 pixels, we have achieved a performance of up to 25 frames per second (fps) for 348×288 images while consuming only 75mW. To our knowledge, this seems to be one of the best performances in terms of fps per watt results for the SV computation. We have also developed and implemented a simple Obstacle Avoidance (OA) algorithm based on the resulting depth map by the SV computation. We have achieved a performance of 21 steering maneuvers per second while consuming 72mW of power. This very limited power consumption indeed enables the use of solar cells as the main source of power for the computing architecture. Such a high performance and low power computing system could enable new capabilities for many aerospace applications and encourage investigations for space qualification of the architecture.

[1]  S. Kung,et al.  VLSI Array processors , 1985, IEEE ASSP Magazine.

[2]  John Iselin Woodfill,et al.  The Tyzx DeepSea G2 Vision System, ATaskable, Embedded Stereo Camera , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[3]  Larry H. Matthies,et al.  Autonomous Navigation Results from the Mars Exploration Rover (MER) Mission , 2004, ISER.

[4]  Antonios Gasteratos,et al.  Stereovision-Based Algorithm for Obstacle Avoidance , 2009, ICIRA.

[5]  John Woodfill,et al.  Real-time stereo vision on the PARTS reconfigurable computer , 1997, Proceedings. The 5th Annual IEEE Symposium on Field-Programmable Custom Computing Machines Cat. No.97TB100186).

[6]  Hai Tao,et al.  Fusion of local appearance with stereo depth for object tracking , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[7]  T. Vladimirova,et al.  Radiation Hardening by Design of Asynchronous Logic for Hostile Environments , 2009, IEEE Journal of Solid-State Circuits.

[8]  Ruigang Yang,et al.  A versatile stereo implementation on commodity graphics hardware , 2005, Real Time Imaging.

[9]  Henry Hoffmann,et al.  On-Chip Interconnection Architecture of the Tile Processor , 2007, IEEE Micro.

[10]  J.J. Biesiadecki,et al.  The Mars Exploration Rover surface mobility flight software driving ambition , 2006, 2006 IEEE Aerospace Conference.

[11]  Elizabeth D. Rather,et al.  Forth Programmer's Handbook , 2007 .

[12]  W. van der Mark,et al.  A comparative study of fast dense stereo vision algorithms , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[13]  Mark L. Chang,et al.  Low-Cost Stereo Vision on an FPGA , 2007 .

[14]  Miao Liao,et al.  High-Quality Real-Time Stereo Using Adaptive Cost Aggregation and Dynamic Programming , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[15]  Andrew E. Johnson,et al.  Computer Vision on Mars , 2007, International Journal of Computer Vision.

[16]  Apostolos Dollas,et al.  Methodology and Experimental Setup for the Determination of System-level Dynamic Reconfiguration Overhead , 2007 .

[17]  G. Blake,et al.  A survey of multicore processors , 2009, IEEE Signal Processing Magazine.

[18]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[20]  Dariu Gavrila,et al.  Real-time dense stereo for intelligent vehicles , 2006, IEEE Transactions on Intelligent Transportation Systems.

[21]  Wolfgang Straßer,et al.  Omnidirectional 3D Modeling on a Mobile Robot using Graph Cuts , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[22]  Gerald H. Hilderink,et al.  Parallel Processing — the picoChip way! , 2003 .

[23]  Jonathan M. Garibaldi,et al.  Real-Time Correlation-Based Stereo Vision with Reduced Border Errors , 2002, International Journal of Computer Vision.

[24]  Javier D. Bruguera,et al.  High Performance Image Processing on a Massively Parallel Processor Array , 2009, 2009 12th Euromicro Conference on Digital System Design, Architectures, Methods and Tools.

[25]  Karin K. Breitman,et al.  When TV Dies, Will It Go to the Cloud? , 2010, Computer.

[26]  Giulio Sandini,et al.  RobotCub: an open framework for research in embodied cognition , 2004, 4th IEEE/RAS International Conference on Humanoid Robots, 2004..

[27]  Scott A. Mahlke,et al.  Mobile Supercomputers for the Next-Generation Cell Phone , 2010, Computer.