Real-time skin feature identification in a time-sequential video stream

Skin color can be an important feature when tracking skin-colored objects. Particularly this is the case for computer-vision-based human-computer interfaces (HCI). Humans have a highly developed feeling of space and, therefore, it is reasonable to support this within intelligent HCI, where the importance of augmented reality can be foreseen. Joining human-like interaction techniques within multimodal HCI could, or will, gain a feature for modern mobile telecommunication devices. On the other hand, real-time processing plays an important role in achieving more natural and physically intuitive ways of human-machine interaction. The main scope of this work is the development of a stereoscopic computer-vision hardware-accelerated framework for real-time skin feature identification in the sense of a single-pass image segmentation process. The hardware-accelerated preprocessing stage is presented with the purpose of color and spatial filtering, where the skin color model within the hue-saturation-value (HSV) color space is given with a polyhedron of threshold values representing the basis of the filter model. An adaptive filter management unit is suggested to achieve better segmentation results. This enables the adoption of filter parameters to the current scene conditions in an adaptive way. Implementation of the suggested hardware structure is given at the level of filed programmable system level integrated circuit (FPSLIC) devices using an embedded microcontroller as their main feature. A stereoscopic clue is achieved using a time-sequential video stream, but this shows no difference for real-time processing requirements in terms of hardware complexity. The experimental results for the hardware-accelerated preprocessing stage are given by efficiency estimation of the presented hardware structure using a simple motion-detection algorithm based on a binary function.

[1]  Surendra Ranganath,et al.  Real-time gesture recognition system and application , 2002, Image Vis. Comput..

[2]  Luc Van Gool,et al.  An adaptive color-based particle filter , 2003, Image Vis. Comput..

[3]  Kazushi Nishimoto,et al.  Design and evaluation of gesture interface of an immersive walk-through application for exploring cyberspace , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[4]  Konstantinos N. Plataniotis,et al.  Automatic location and tracking of the facial region in color video sequences , 1999, Signal Process. Image Commun..

[5]  Paul Y. S. Cheung,et al.  Quadrilateral-based region segmentation for tracking , 2002 .

[6]  Ralph Etienne-Cummings,et al.  A Vision Chip for Color Segmentation and Pattern Matching , 2003, EURASIP J. Adv. Signal Process..

[7]  Mi-Suen Lee,et al.  Real time skin-region detection with a single-chip digital camera , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[8]  Hilary Buxton,et al.  Learning and understanding dynamic scene activity: a review , 2003, Image Vis. Comput..