Moving portraits

We present an approach for generating face animations from large image collections of the same person. Such collections, which we call photobios, are remarkable in that they summarize a person's life in photos; the photos sample the appearance of a person over changes in age, pose, facial expression, hairstyle, and other variations. Yet, browsing and exploring photobios is infeasible due to their large volume. By optimizing the quantity and order in which photos are displayed and cross dissolving between them, we can render smooth transitions between face pose (e.g., from frowning to smiling), and create moving portraits from collections of still photos. Used in this context, the cross dissolve produces a very strong motion effect; a key contribution of the paper is to explain this effect and analyze its operating range. We demonstrate results on a variety of datasets including time-lapse photography, personal photo collections, and images of celebrities downloaded from the Internet. Our approach is completely automatic and has been widely deployed as the "Face Movies" feature in Google's Picasa.

[1]  Amalia L. Cabezas,et al.  Tropical Blues , 2008 .

[2]  Ira Kemelmacher-Shlizerman,et al.  Exploring photobios , 2011, ACM Trans. Graph..

[3]  M. Manalansan,et al.  Queer Intersections: Sexuality and Gender in Migration Studies , 2006 .

[4]  Erica Klarreich,et al.  Hello, my name is… , 2014, CACM.

[5]  Stephanie Taylor,et al.  Identity Trouble and Opportunity in Women's Narratives of Residence , 2005 .

[6]  Li Zhang,et al.  Spacetime faces: high resolution capture for modeling and animation , 2004, SIGGRAPH 2004.

[7]  Arnaldo Cruz-Malavé,et al.  Queer Latino Testimonio, Keith Haring, and Juanito Xtravaganza , 2007 .

[8]  Lynn A. Meisch Gringas and otavaleños: Changing tourist relations , 1995 .

[9]  Peter A Guarnero,et al.  Family and Community Influences on the Social and Sexual Lives of Latino Gay Men , 2007, Journal of transcultural nursing : official journal of the Transcultural Nursing Society.

[10]  Ramón Grosfoguel,et al.  “Coloniality of power” and racial dynamics: Notes toward a reinterpretation of Latino Caribbeans in New York City , 2000 .

[11]  Christoph Bregler,et al.  Video Rewrite: Driving Visual Speech with Audio , 1997, SIGGRAPH.

[12]  Nancy K. Napier,et al.  An American Woman in Turkey: Adventures Unexpected and Knowledge Unplanned , 2001 .

[13]  C. Loftin,et al.  Unacceptable Mannerisms: Gender Anxieties, Homosexual Activism, and Swish in the United States, 1945-1965 , 2007 .

[14]  Steven M. Seitz,et al.  View morphing , 1996, SIGGRAPH.

[15]  P. Ho,et al.  Negotiating Anal Intercourse in Inter-Racial Gay Relationships in Hong Kong , 2000 .

[16]  Jasbir K. Puar,et al.  Circuits of Queer Mobility: Tourism, Travel, and Globalization , 2002 .

[17]  Daniel Balderston,et al.  A Beautiful, Sinister Fairyland: Gay Sunshine Press Does Latin America , 2003 .

[18]  M. Polanyi,et al.  Tacit Knowing: Its Bearing on Some Problems of Philosophy , 1962 .

[19]  Maja Horn,et al.  Queer Caribbean Homecomings: The Collaborative Art Exhibits of Nelson Ricart-Guerrero and Christian Vauzelle , 2008 .

[20]  M Nesvig,et al.  The Complicated Terrain of Latin American Homosexuality , 2001, The Hispanic American historical review.

[21]  Barry D Adam,et al.  Constructing the neoliberal sexual actor: Responsibility and care of the self in the discourse of barebackers , 2005, Culture, health & sexuality.

[22]  C. Decena,et al.  Profiles, Compulsory Disclosure and Ethical Sexual Citizenship in the Contemporary USA , 2008 .

[23]  Dereka Rushbrook,et al.  Sexuality and Space: Queering Geographies of Globalization , 2003 .

[24]  Pedro Bustos-Aguilar,et al.  Mister Don't Touch the Banana , 1995 .

[25]  Stephanie Taylor,et al.  Self-narration as rehearsal: A discursive approach to the narrative formation of identity , 2005 .

[26]  Andrew Zisserman,et al.  Hello! My name is... Buffy'' -- Automatic Naming of Characters in TV Video , 2006, BMVC.

[27]  A. Ramos-Zayas,et al.  Implicit Social Knowledge, Cultural Capital, and “Authenticity” among Puerto Ricans in Chicago , 2004 .

[28]  S. Ullman,et al.  Geometry and photometry in three-dimensional visual recognition , 1993 .

[29]  John Lasseter,et al.  Principles of traditional animation applied to 3D computer animation , 1987, SIGGRAPH.

[30]  Hiram Perez,et al.  You Can Have My Brown Body and Eat It, Too! , 2005 .

[31]  S. Peña,et al.  "Obvious Gays" and the State Gaze: Cuban Gay Visibility and U.S. Immigration Policy during the 1980 Mariel Boatlift , 2007, Journal of the History of Sexuality.

[32]  J K Puar,et al.  Global Circuits: Transnational Sexualities and Trinidad , 2001, Signs: Journal of Women in Culture and Society.

[33]  Jonathan Brandt,et al.  Robust object detection via soft cascade , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[34]  Stephanie Taylor,et al.  A Suitable Time and Place , 1999 .

[35]  Salvador Vidal-Ortiz,et al.  On Being a White Person of Color: Using Autoethnography to Understand Puerto Ricans' Racialization , 2004 .

[36]  L. Guarnizo,et al.  Los Dominicanyorks: , 1994 .

[37]  L. McCall The Complexity of Intersectionality , 2005, Signs: Journal of Women in Culture and Society.

[38]  Thomas O. Binford,et al.  On Detecting Edges , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[40]  Roger Rouse,et al.  Mexican Migration and the Social Space of Postmodernism , 1991, Diaspora: A Journal of Transnational Studies.

[41]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[42]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[43]  Curtis Dolezal,et al.  Looking for a tall, dark, macho man … sexual‐role behaviour variations in Latino gay and bisexual men , 2004 .

[44]  Ellen Samuels,et al.  My Body, My Closet: Invisible Disability and the Limits of Coming-Out Discourse , 2003 .

[45]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[46]  Ira Kemelmacher-Shlizerman,et al.  Being John Malkovich , 2010, ECCV.

[47]  A. Ramos-Zayas,et al.  BECOMING AMERICAN, BECOMING BLACK? URBAN COMPETENCY, RACIALIZED SPACES, AND THE POLITICS OF CITIZENSHIP AMONG BRAZILIAN AND PUERTO RICAN YOUTH IN NEWARK , 2007 .

[48]  Jasbir K. Puar,et al.  A Transnational Feminist Critique of Queer Tourism , 2002 .

[49]  Jared Braiterman,et al.  Sexual Science: Whose Cultural Difference? , 1998 .

[50]  Stephanie Taylor,et al.  Narrative as construction and discursive resource , 2006 .

[51]  Arnaldo Cruz Malavé Para virar al macho: la autobiografía como subversión en la cuentística de Manuel Ramos Otero , 1993 .

[52]  Ginetta E. B. Candelario Hair Race-ing: Dominican Beauty Culture and Identity Production , 2000 .

[53]  Yee Whye Teh,et al.  Names and faces in the news , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[54]  Sasho Alexander Lambevski,et al.  Suck My Nation - Masculinity, Ethnicity and the Politics of (Homo)sex , 1999 .

[55]  J. Urry,et al.  The New Mobilities Paradigm , 2006 .

[56]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[57]  P. Collins,et al.  Negotiating Selves: Reflections on ‘Unstructured’ Interviewing , 1998 .

[58]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH '08.

[59]  Scott Taylor,et al.  Time for Space: A Narrative Review of Research on Organizational Spaces , 2007 .

[60]  R. Basri,et al.  Direct visibility of point sets , 2007, SIGGRAPH 2007.

[61]  Denise Brennan,et al.  What's Love Got to Do with It?: Transnational Desires and Sex Tourism in the Dominican Republic , 2004 .

[62]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[63]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[64]  Antonio Lauria-Perricelli,et al.  "Respeto," "Relajo" and Inter-Personal Relations in Puerto Rico , 1964 .

[65]  Jafari Sinclaire Allen,et al.  MEANS OF DESIRE'S PRODUCTION: MALE SEX LABOR IN CUBA 1 , 2007 .

[66]  Scott A. Schwenter Diferenciación dialectal por medio de pronombres: una comparación del uso de "tú" y "usted" en España y México , 1993 .

[67]  M. Manalansan,et al.  Colonizing Time and Space: Race and Romance in Brokeback Mountain , 2006 .

[68]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[69]  S. Gal,et al.  A Semiotics of the Public/Private Distinction , 2002 .

[70]  D. Leheny,et al.  A political economy of Asian sex tourism , 1995 .

[71]  Diana Fisher,et al.  Immigrant Closets , 2003, Journal of homosexuality.

[72]  Lauren M. P. Derby,et al.  The Dictator's Seduction: Politics and the Popular Imagination in the Era of Trujillo , 2009 .

[73]  E. Herold,et al.  Female tourists and beach boys: Romance or Sex Tourism? , 2001 .

[74]  Kira Hall,et al.  Theorizing identity in language and sexuality research , 2004, Language in Society.

[75]  A. Shashua Geometry and Photometry in 3D Visual Recognition , 1992 .

[76]  K. Crenshaw Mapping the margins: intersectionality, identity politics, and violence against women of color , 1991 .

[77]  Camilla Stevens The Politics of Abjection In P.A.R.G.O.: Los Pecados Permitidos By Waddys Jaquez , 2008 .

[78]  Soile Eeva Johanna Veijola,et al.  The Body in Tourism , 1994 .

[79]  Richard Szeliski,et al.  PSF estimation using sharp edge prediction , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[80]  Stephanie Taylor A place for the future? Residence and continuity in women's narratives of their lives , 2003 .

[81]  Kamala Kempadoo,et al.  Freelancers, Temporary Wives, and Beach-Boys: Researching Sex Work in the Caribbean , 2001 .

[82]  Thaddeus Beier,et al.  Feature-based image metamorphosis , 1992, SIGGRAPH.

[83]  David Salesin,et al.  Video object annotation, navigation, and composition , 2008, UIST '08.