A 69mW 140-meter/60fps and 60-meter/300fps intelligent vision SoC for versatile automotive applications

A machine-learning based intelligent vision SoC implemented on a 9.3 mm2 die in a 40nm CMOS process is presented. The architecture realizes 140 meters active distance at 60fps and 60 meters at 300fps under Quad-VGA (1280×960) resolution while maintaining above 90% detection rate for versatile automotive applications. The system supports 64 object tracking and prediction. It raises 1.62× improvement on power efficiency and at least 1.79× increase on frame rate with the proposed knowledge-based tracking processor. The chip achieves 354.2fps/W and 3.01TOPS/W power efficiency with 69mW average power consumption.

[1]  Liang-Gee Chen,et al.  A 52mW full HD 160-degree object viewpoint recognition SoC with visual vocabulary processor for wearable vision applications , 2011, 2011 Symposium on VLSI Circuits - Digest of Technical Papers.

[2]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[3]  Liang-Gee Chen,et al.  A multimedia semantic analysis SoC (SASoC) with machine-learning engine , 2010, 2010 IEEE International Solid-State Circuits Conference - (ISSCC).

[4]  Hoi-Jun Yoo,et al.  A 201.4 GOPS 496 mW Real-Time Multi-Object Recognition Processor With Bio-Inspired Neural Perception Engine , 2009, IEEE Journal of Solid-State Circuits.

[5]  Tadahiro Kuroda,et al.  A versatile recognition processor employing Haar-like feature and cascaded classifier , 2009, 2009 IEEE International Solid-State Circuits Conference - Digest of Technical Papers.

[6]  Donghyun Kim,et al.  A 201.4GOPS 496mW real-time multi-object recognition processor with bio-inspired neural perception engine , 2009, 2009 IEEE International Solid-State Circuits Conference - Digest of Technical Papers.

[7]  Hoi-Jun Yoo,et al.  A 345 mW Heterogeneous Many-Core Processor With an Intelligent Inference Engine for Robust Object Recognition , 2011, IEEE J. Solid State Circuits.