Finding Naked People

This paper demonstrates a content-based retrieval strategy that can tell whether there are naked people present in an image. No manual intervention is required. The approach combines color and texture properties to obtain an effective mask for skin regions. The skin mask is shown to be effective for a wide range of shades and colors of skin. These skin regions are then fed to a specialized grouper, which attempts to group a human figure using geometric constraints on human structure. This approach introduces a new view of object recognition, where an object model is an organized collection of grouping hints obtained from a combination of constraints on geometric properties such as the structure of individual parts, and the relationships between parts, and constraints on color and texture. The system is demonstrated to have 60% precision and 52% recall on a test set of 138 uncontrolled images of naked people, mostly obtained from the internet, and 1401 assorted control images, drawn from a wide collection of sources.

[1]  L. Spier,et al.  Language, culture, and personality : essays in memory of Edward Sapir , 1942 .

[2]  Barry Taylor,et al.  Tense and continuity , 1977, Linguistics and Philosophy.

[3]  Ramakant Nevatia,et al.  Description and Recognition of Curved Objects , 1977, Artif. Intell..

[4]  J. O'Rourke,et al.  Model-based image analysis of human motion using constraint propagation , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  G. H. Jacobs Comparative Color Vision , 1981 .

[6]  Rodney A. Brooks,et al.  Symbolic Reasoning Among 3-D Models and 2-D Images , 1981, Artif. Intell..

[7]  David C. Hogg Model-based vision: a program to see a walking person , 1983, Image Vis. Comput..

[8]  M. Brady,et al.  Smoothed Local Symmetries and Their Implementation , 1984 .

[9]  Koichiro Akita,et al.  Image sequence analysis of real world human motion , 1984, Pattern Recognit..

[10]  Hsi-Jian Lee,et al.  Determination of 3D human body postures from a single view , 1985, Comput. Vis. Graph. Image Process..

[11]  Anne Treisman,et al.  Preattentive processing in vision , 1985, Computer Vision Graphics and Image Processing.

[12]  John K. Tsotsos,et al.  Ambient illumination and the determination of material changes. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[13]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  W. Eric L. Grimson,et al.  Localizing Overlapping Parts by Searching the Interpretation Tree , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Michael Brady,et al.  Generating and Generalizing Models of Visual Objects , 1987, Artif. Intell..

[16]  C. Tenny Grammaticalizing aspect and affectedness , 1987 .

[17]  Isaac Weiss,et al.  Projective invariants of shapes , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  D. Alman Colour—Why the World Isn't Grey, by Hazel Rossotti, Princeton University Press, Princeton, 1985, 239 pp., paperbound. Price $9.95 , 1989 .

[19]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  David A. Forsyth,et al.  Efficient model library access by projectively invariant indexing functions , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Andrew Zisserman,et al.  Geometric invariance in computer vision , 1992 .

[22]  G. Taubin,et al.  Object recognition based on moment (or algebraic) invariants , 1992 .

[23]  Tat-Seng Chua,et al.  Applying relevance feedback to a photo archival system , 1992, J. Inf. Sci..

[24]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[25]  David J. Kriegman,et al.  Representations for Recognizing Complex Curved 3D Objects , 1994, Object Representation in Computer Vision.

[26]  S. Ahmad,et al.  A usable real-time 3D hand tracker , 1994, Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers.

[27]  K. Rohr Towards model-based recognition of human movements in image sequences , 1994 .

[28]  Alex Pentland,et al.  View-based and modular eigenspaces for face recognition , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Sara Shatford Layne,et al.  Some Issues in the Indexing of Images , 1994, J. Am. Soc. Inf. Sci..

[30]  Mubarak Shah,et al.  A survey of motion analysis from moving light displays , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Margaret M. Fleck Practical edge finding with a robust estimator , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Michael C. Burl,et al.  Finding faces in cluttered scenes using random labeled graph matching , 1995, Proceedings of IEEE International Conference on Computer Vision.

[33]  David A. Forsyth,et al.  Class-based grouping in perspective images , 1995, Proceedings of IEEE International Conference on Computer Vision.

[34]  Stan Sclaroff World Wide Web Image Search Engines , 1995 .

[35]  Yihong Gong,et al.  Detection of Regions Matching Specified Chromatic Features , 1995, Comput. Vis. Image Underst..

[36]  David Salesin,et al.  Fast multiresolution image querying , 1995, SIGGRAPH.

[37]  T. M. Cannon,et al.  Query by image example: the comparison algorithm for navigating digital image databases (CANDID) approach , 1995, Electronic imaging.

[38]  J. Ashley,et al.  Automatic and Semi-Automatic Methods for Image Annotation and Retrieval in QBIC , 1995 .

[39]  Michael Stonebraker,et al.  Chabot: Retrieval from a Relational Database of Images , 1995, Computer.

[40]  Demas Sanger,et al.  Method for light source discrimination and facial pattern detection from negative color films , 1995 .

[41]  Takeo Kanade,et al.  Model-based tracking of self-occluding articulated objects , 1995, Proceedings of IEEE International Conference on Computer Vision.

[42]  Takeo Kanade,et al.  Human Face Detection in Visual Scenes , 1995, NIPS.

[43]  Thomas P. Minka,et al.  An image database browser that learns from user interaction , 1996 .

[44]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Other Conferences.

[45]  Tomaso A. Poggio,et al.  Example-Based Learning for View-Based Human Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  J. Peregrin LINGUISTICS AND PHILOSOPHY , 1998 .