Context based detection of keypoints and features in eye regions

Facial keypoints such as eye corners are important features for a number of different tasks in automatic face processing. The problem is that facial keypoints rather have an anatomical high-level definition than a low-level one. Therefore, they cannot be detected reliably by purely data-driven methods like corner detectors that are only based on the image data of the local neighborhood. In this contribution we introduce a method for the automatic detection of facial keypoints. The method integrates model knowledge to guarantee a consistent interpretation of the abundance of local features. The detection is based on a selective search and sequential tracking of edges controlled by model knowledge. For this, the edge detection has to be very flexible. Therefore, we apply a powerful filtering scheme based on steerable filters.