Magic Morphin' Mirror: Person Detection and Tracking

The demo presents a virtual mirror interface which reacts to the viewer using robust, real-time face tracking. The display directly combines a user's face with various graphical distortions, performed only on the face region in the image. The face detection and tracking is done in real-time, so the graphical effect stays with the user and continues to adapt al; they move within the viewing space, increasing in intensity as the user approaches the display.The tracking system performs well in crowded environments with open and moving backgrounds. This robust performance is achieved using multi-modal integration, combining stereo, color, and grey-scale pattern matching modules into 2 single realtime system. Stereo processing is used to isolate the figure of a user from other objects and people in the background. Skinhue classification identifies and tracks likely body parts within the foreground region. Face pattern detection discriminates and localizes the face within the tracked body parts. A second set of displays, located to the side of the main viewing area, shows intermediate results of each processing module of the system.