Creating Body Shapes From Verbal Descriptions by Linking Similarity Spaces

Brief verbal descriptions of people’s bodies (e.g., “curvy,” “long-legged”) can elicit vivid mental images. The ease with which these mental images are created belies the complexity of three-dimensional body shapes. We explored the relationship between body shapes and body descriptions and showed that a small number of words can be used to generate categorically accurate representations of three-dimensional bodies. The dimensions of body-shape variation that emerged in a language-based similarity space were related to major dimensions of variation computed directly from three-dimensional laser scans of 2,094 bodies. This relationship allowed us to generate three-dimensional models of people in the shape space using only their coordinates on analogous dimensions in the language-based description space. Human descriptions of photographed bodies and their corresponding models matched closely. The natural mapping between the spaces illustrates the role of language as a concise code for body shape that captures perceptually salient global and local body features.

[1]  Michael J. Black,et al.  Can I Recognize My Body's Weight? The Influence of Shape and Texture on the Perception of Self , 2014, ACM Trans. Appl. Percept..

[2]  M. Friedman,et al.  Is Obesity Stigmatizing? Body Weight, Perceived Discrimination, and Psychological Well-Being in the United States∗ , 2005, Journal of health and social behavior.

[3]  M. Greenacre Correspondence analysis in practice , 1993 .

[4]  Fei-Fei Li,et al.  What, where and who? Classifying events by scene and object recognition , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[5]  Levent Burak Kara,et al.  Semantic shape editing using deformation handles , 2015, ACM Trans. Graph..

[6]  Nouchine Hadjikhani,et al.  Non-conscious recognition of emotional body language , 2006, Neuroreport.

[7]  B. de Gelder,et al.  The perception of emotion in body expressions. , 2015, Wiley interdisciplinary reviews. Cognitive science.

[8]  Alice J. O'Toole,et al.  A video database of moving faces and people , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Christoph H. Lampert,et al.  Attribute-Based Classification for Zero-Shot Visual Object Categorization , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Jovan Popović,et al.  Deformation transfer for triangle meshes , 2004, SIGGRAPH 2004.

[11]  Rebecca F. Schwarzlose,et al.  Separate Face and Body Selectivity on the Fusiform Gyrus , 2005, The Journal of Neuroscience.

[12]  Max Coltheart,et al.  The effects of inversion and familiarity on face versus body cues to person recognition. , 2012, Journal of experimental psychology. Human perception and performance.

[13]  Zoran Popovic,et al.  The space of human body shapes: reconstruction and parameterization from range scans , 2003, ACM Trans. Graph..

[14]  Carina A. Hahn,et al.  Dissecting the time course of person recognition in natural viewing environments. , 2016, British journal of psychology.

[15]  Thomas E. Currie,et al.  The relative importance of the face and body in judgments of human physical attractiveness , 2009 .

[16]  Matthew Q. Hill,et al.  Body talk , 2016, ACM Trans. Graph..

[17]  Ali Farhadi,et al.  Describing objects by their attributes , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Hervé Abdi,et al.  Correspondence Analysis , 2014, Encyclopedia of Social Network Analysis and Mining.

[19]  K. Grill-Spector,et al.  The functional architecture of the ventral temporal cortex and its role in categorization , 2014, Nature Reviews Neuroscience.

[20]  Michael J. Black,et al.  Coregistration: Simultaneous Alignment and Modeling of Articulated 3D Shape , 2012, ECCV.

[21]  Shree K. Nayar,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence Describable Visual Attributes for Face Verification and Image Search , 2022 .

[22]  Sebastian Thrun,et al.  SCAPE: shape completion and animation of people , 2005, SIGGRAPH 2005.

[23]  Dragomir Anguelov,et al.  SCAPE: shape completion and animation of people , 2005, ACM Trans. Graph..

[24]  Vaidehi S. Natu,et al.  Unaware Person Recognition From the Body When Face Identification Fails , 2013, Psychological science.

[25]  A. O'Toole,et al.  The Role of the Face and Body in Unfamiliar Person Identification , 2013 .

[26]  V. Bruce,et al.  Face Recognition in Poor-Quality Video: Evidence From Security Surveillance , 1999 .

[27]  Y. Trope,et al.  Body Cues, Not Facial Expressions, Discriminate Between Intense Positive and Negative Emotions , 2012, Science.

[28]  Gilbert Saporta,et al.  L'analyse des données , 1981 .

[29]  Chelsea A. Heuer,et al.  The Stigma of Obesity: A Review and Update , 2009, Obesity.

[30]  A. Lowenfels A REVIEW AND UPDATE , 1979 .

[31]  G. Rhodes,et al.  Does attractiveness in men provide clues to semen quality? , 2008, Journal of evolutionary biology.

[32]  P. Downing,et al.  Selectivity for the human body in the fusiform gyrus. , 2005, Journal of neurophysiology.

[33]  Mark S. Nixon,et al.  Soft Biometrics; Human Identification Using Comparative Descriptions , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Robert Bergevin,et al.  Semantic human activity recognition: A literature review , 2015, Pattern Recognit..

[35]  N. Kanwisher,et al.  A Cortical Area Selective for Visual Processing of the Human Body , 2001, Science.