Stereo Vision embedded system for Augmented Reality

Stereo Vision processing is a critical component of Augmented Reality systems that rely on the precise depth map of a scene to properly place computer generated objects with real life video. Important aspects of the stereo processing are the creation of a dense depth map, high boundary precision, low latency and low power. We present an embedded system for Stereo Vision Processing based on a custom GigE vision board with an Altera Stratix IV FPGA and the Acadia® II System-On-Chip that replaces an existing GPU/PC based system. By porting the stereo algorithm to an FPGA, we reduced the size and power requirements by reducing the workload of the CPU and eliminated the need of a high-end graphics card. The embedded system processes the same algorithm as the GPU/PC based system, but at 10× lower power and lower latency. Placed in a small enclosure, the overall system enables more user mobility for a more compelling user experience.

[1]  Larry Matthies,et al.  FPGA implementation of stereo disparity with high throughput for mobility applications , 2011, 2011 Aerospace Conference.

[2]  Jilin Liu,et al.  Improved real-time correlation-based FPGA stereo vision system , 2010, 2010 IEEE International Conference on Mechatronics and Automation.

[3]  Richard P. Wildes,et al.  Coarse-to-fine stereo vision with accurate 3D boundaries , 2010, Image Vis. Comput..

[4]  Supun Samarasekera,et al.  Stable vision-aided navigation for large-area augmented reality , 2011, 2011 IEEE Virtual Reality Conference.

[5]  W. James MacLean,et al.  Expanding Disparity Range in an FPGA Stereo System While Keeping Resource Utilization Low , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[6]  Gooitzen S. van der Wal Technical overview of the Sarnoff Acadia II vision processor , 2010 .

[7]  A. C. Sonmez,et al.  FPGA design and implementation of a real-time stereo vision system , 2012, 2012 International Symposium on Innovations in Intelligent Systems and Applications.

[8]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[9]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..