Human facial illustrations: Creation and psychophysical evaluation

We present a method for creating black-and-white illustrations from photographs of human faces. In addition an interactive technique is demonstrated for deforming these black-and-white facial illustrations to create caricatures which highlight and exaggerate representative facial features. We evaluate the effectiveness of the resulting images through psychophysical studies to assess accuracy and speed in both recognition and learning tasks. These studies show that the facial illustrations and caricatures generated using our techniques are as effective as photographs in recognition tasks. For the learning task we find that illustrations are learned two times faster than photographs and caricatures are learned one and a half times faster than photographs. Because our techniques produce images that are effective at communicating complex information, they are useful in a number of potential applications, ranging from entertainment and education to low bandwidth telecommunications and psychology research.

[1]  H. Ellis,et al.  Face recognition accuracy as a function of mode of representation. , 1978 .

[2]  Kirk Martinez,et al.  Computer Generated Cartoons , 1990 .

[3]  S Grossberg,et al.  Neural dynamics of brightness perception: Features, boundaries, diffusion, and resonance , 1984, Perception & Psychophysics.

[4]  David Salesin,et al.  Interactive pen-and-ink illustration , 1994, SIGGRAPH.

[5]  J Sweller A Test between the Selective Attention and Stimulus Generalization Interpretations of the Easy-to-hard Effect , 1972, The Quarterly journal of experimental psychology.

[6]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[7]  David Salesin,et al.  Computer-generated pen-and-ink illustration , 1994, SIGGRAPH.

[8]  T. Valentine The Quarterly Journal of Experimental Psychology Section A: Human Experimental Psychology a Unified Account of the Effects of Distinctiveness, Inversion, and Race in Face Recognition , 2022 .

[9]  M. Tarr,et al.  Activation of the middle fusiform 'face area' increases with expertise in recognizing novel objects , 1999, Nature Neuroscience.

[10]  H. M. Hanson Effects of discrimination training on stimulus generalization. , 1959, Journal of experimental psychology.

[11]  J. B. Martens,et al.  An object-oriented model for brightness perception. , 1990, Spatial vision.

[12]  A. Young,et al.  Aspects of face processing , 1986 .

[13]  Susan E. Brennan,et al.  Caricature Generator: The Dynamic Exaggeration of Faces by Computer , 2017 .

[14]  Gordon L. Shulman,et al.  Cognitive Control of Rotation in Depth , 1994 .

[15]  J. Kerr,et al.  Experimental effects of finite transmitter apertures on scintillations , 1973 .

[16]  Ergun Akleman,et al.  Making Extreme Caricatures with a New Interactive 2D Deformation Technique with Simplicial Complexes , 2006 .

[17]  Joseph J. Atick,et al.  What Does the Retina Know about Natural Scenes? , 1992, Neural Computation.

[18]  Mario Costa Sousa,et al.  Observational Model of Blenders and Erasers in Computer-Generated Pencil Rendering , 1999, Graphics Interface.

[19]  Toshimitsu Tanaka,et al.  Painting‐like Image Emphasis based on Human Vision Systems , 1997, Comput. Graph. Forum.

[20]  R. Weale Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. David Marr , 1983 .

[21]  B. Wandell Foundations of vision , 1995 .

[22]  I. Biederman,et al.  Neural and psychophysical analysis of object and face recognition , 1998 .

[23]  V. Ramachandran,et al.  The science of art: A neurological theory of aesthetic experience , 1999 .

[24]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[25]  D. Perrett,et al.  Visual Processing of Facial Distinctiveness , 1994, Perception.

[26]  R Goldstein,et al.  Lightness models, gradient illusions, and curl , 1987, Perception & psychophysics.

[27]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[28]  E. Reinhard Photographic Tone Reproduction for Digital Images , 2002 .

[29]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  G. Rhodes,et al.  Averageness, Exaggeration, and Facial Attractiveness , 1996 .

[31]  Vicki Bruce,et al.  Face Recognition: From Theory to Applications , 1999 .

[32]  Sarah V. Stevenage,et al.  Can caricatures really produce distinctiveness effects , 1995 .

[33]  Heiko Neumann,et al.  A Contrast- and Luminance-driven Multiscale Network Model of Brightness Perception , 1995, Vision Research.

[34]  H. D. Ellis,et al.  Introduction to Aspects of Face Processing: Ten Questions in Need of Answers , 1986 .

[35]  G. Rhodes,et al.  Understanding face recognition: Caricauture effects, inversion, and the homogeneity problem , 1994 .

[36]  Michael Kubovy,et al.  Caricature and face recognition , 1992, Memory & cognition.

[37]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[38]  H. Barlow Vision Science: Photons to Phenomenology by Stephen E. Palmer , 2000, Trends in Cognitive Sciences.

[39]  G. Rhodes,et al.  Identification and ratings of caricatures: Implications for mental representations of faces , 1987, Cognitive Psychology.

[40]  A. Young,et al.  The faces that launched a thousand slips: everyday difficulties and errors in recognizing people. , 1985, British journal of psychology.

[41]  Michael B. Lewis,et al.  Please Scroll down for Article the Quarterly Journal of Experimental Psychology Section a Understanding Caricatures of Faces , 2022 .

[42]  Lenn Redman,et al.  How To Draw Caricatures , 1984 .

[43]  D. Perrett,et al.  Perception and recognition of photographic quality facial caricatures: Implications for the recognition of natural images , 1991 .

[44]  B. Tversky,et al.  Memory for faces: Are caricatures better than photographs? , 1985, Memory & cognition.

[45]  David Salesin,et al.  Scale-dependent reproduction of pen-and-ink illustrations , 1996, SIGGRAPH.

[46]  Alan N. Gove,et al.  Brightness perception, illusory contours, and corticogeniculate feedback , 1995, Visual Neuroscience.

[47]  Victor Ostromoukhov Digital facial engraving , 1999, SIGGRAPH '99.

[48]  Heiko Neumann,et al.  A simple cell model with dominating opponent inhibition for robust contrast detection , 2000, Kognitionswissenschaft.

[49]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[50]  T. Hansen,et al.  Ein Modell kortikaler Einfachzellen mit dominanter opponenter Inhibition zur robusten Kontrastdetektion , 2000 .

[51]  David Salesin,et al.  Orientable textures for image-based pen-and-ink illustration , 1997, SIGGRAPH.

[52]  D.E. Pearson,et al.  Visual communication at very low data rates , 1985, Proceedings of the IEEE.

[53]  A. D. Yarmey,et al.  I recognize your face but I can’t remember your name: Further evidence on the tip-of-the-tongue phenomenon , 1973, Memory & cognition.

[54]  Frédo Durand,et al.  Decoupling Strokes and High-Level Attributes for Interactive Traditional Drawing , 2001, Rendering Techniques.