A low cost FPGA system for high speed face detection and tracking

We present an FPGA face detection and tracking system for audiovisual communications, with a particular focus on mobile videoconferencing. The advantages of deploying such a technology in a mobile handset are many, including face stabilisation, reduced bit rate, and higher quality video on practical display sizes. Most face detection methods, however, assume at least modest general purpose processing capabilities, making them inappropriate for real-time applications, especially for power-limited devices, as well as modest custom hardware implementations. We present a method which achieves a very high detection and tracking performance and, at the same time, entails a significantly reduced computational complexity, allowing real-time implementations on custom hardware or simple microprocessors. We then propose on FPGA implementation which entails very low logic and memory costs and achieves extremely high processing rates at very low clock speeds.

[1]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[2]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[3]  Keith R. Dimond,et al.  A hardware FPGA implementation of a 2D median filter using a novel rank adjustment technique , 1999 .

[4]  Clement T. Yu,et al.  Detecting human faces in color images , 1998, Proceedings International Workshop on Multi-Media Database Management Systems (Cat. No.98TB100249).

[5]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[6]  Miroslaw Bober,et al.  An FPGA System for the High Speed Extraction, Normalization and Classification of Moment Descriptors , 2003, FPL.

[7]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[8]  K. Rijkse,et al.  H.263: video coding for low-bit-rate communication , 1996, IEEE Commun. Mag..

[9]  T. K. Leungfj,et al.  Finding Faces in Cluttered Scenes using Random Labeled Graph Matching , 1995 .

[10]  Narendra Ahuja,et al.  Face detection using mixtures of linear subspaces , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[11]  Stavros Paschalakis Moment methods and hardware architectures for high speed binary, greyscale and colour pattern recognition , 2001 .

[12]  David A. Forsyth,et al.  Finding Naked People , 1996, ECCV.

[13]  Itu-T Video coding for low bitrate communication , 1996 .