Using artificially generated pictures in customer-facing systems: an evaluation study with data-driven personas

We conduct two studies to evaluate the suitability of artificially generated facial pictures for use in a customer-facing system using data-driven personas. STUDY 1 investigates the quality of a sa...

[1]  Cordelia Schmid,et al.  How good is my GAN? , 2018, ECCV.

[2]  K. Gwet.  Computing inter-rater reliability and its variance in the presence of high agreement. , 2008, The British journal of mathematical and statistical psychology.

[3]  Philipp Brauner,et al.  What happens when decision support systems fail? — the importance of usability on performance in erroneous systems , 2019, Behav. Inf. Technol..

[4]  Bernard J. Jansen,et al.  “Is More Better?”: Impact of Multiple Photos on Perception of Persona Profiles , 2018, CHI.

[5]  Mustafa Utku Özmen,et al.  Handling of online information by users: evidence from TED talks , 2019, Behav. Inf. Technol..

[6]  Margaret M. Burnett,et al.  Gender-Inclusiveness Personas vs. Stereotyping: Can We Have it Both Ways? , 2017, CHI.

[7]  Liang Lin,et al.  BeautyGAN: Instance-level Facial Makeup Transfer with Deep Generative Adversarial Network , 2018, ACM Multimedia.

[8]  Bernard J. Jansen,et al.  Generating Cultural Personas from Social Data: A Perspective of Middle Eastern Users , 2017, 2017 5th International Conference on Future Internet of Things and Cloud Workshops (FiCloudW).

[9]  Vishal M. Patel,et al.  Face Synthesis from Visual Attributes via Sketch using Conditional VAEs and GANs , 2017, ArXiv.

[10]  Jan Stage,et al.  A Template for Design Personas: Analysis of 47 Persona Descriptions from Danish Industries and Organizations , 2015, Int. J. Sociotechnology Knowl. Dev..

[11]  Rolph E. Anderson,et al.  Multivariate Data Analysis (7th ed. , 2009 .

[12]  Nalini Kotamraju,et al.  Data-driven persona development , 2008, CHI.

[13]  Kenny Mitchell,et al.  Photo-Realistic Facial Details Synthesis From Single Image , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[14]  Xin Yang,et al.  Exposing Deep Fakes Using Inconsistent Head Poses , 2018, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  Bernard J. Jansen,et al.  Does a Smile Matter if the Person Is Not Real?: The Effect of a Smile and Stock Photos on Persona Perceptions , 2019, Int. J. Hum. Comput. Interact..

[16]  Omar Alonso,et al.  Practical Lessons for Gathering Quality Labels at Scale , 2015, SIGIR.

[17]  Bernard J. Jansen,et al.  Persona Transparency: Analyzing the Impact of Explanations on Perceptions of Data-Driven Personas , 2019, Int. J. Hum. Comput. Interact..

[18]  Xiangyang Xue,et al.  Semi-Latent GAN: Learning to generate and modify facial images from attributes , 2017, ArXiv.

[19]  Kiyoshi Tanaka,et al.  ArtGAN: Artwork synthesis with conditional categorical GANs , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[20]  Bernard J. Jansen,et al.  Automatically Conceptualizing Social Media Analytics Data via Personas , 2018, ICWSM.

[21]  Stefan Palan,et al.  Prolific.ac—A subject pool for online experiments , 2017 .

[22]  M. Banerjee,et al.  Beyond kappa: A review of interrater agreement measures , 1999 .

[23]  Sepp Hochreiter,et al.  GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium , 2017, NIPS.

[24]  Bernard J. Jansen,et al.  Who are your users?: comparing media professionals' preconception of users to data-driven personas , 2017, OZCHI.

[25]  Karin Slegers,et al.  Personas and Behavioral Theories: A Case Study Using Self-Determination Theory to Construct Overweight Personas , 2017, CHI.

[26]  Bradley Alexander,et al.  Evolution of Images with Diversity and Constraints Using a Generative Adversarial Network , 2018, ICONIP.

[27]  Brian R. Duffy,et al.  Anthropomorphism and the social robot , 2003, Robotics Auton. Syst..

[28]  P. Barrett.  Structural equation modelling : Adjudging model fit , 2007 .

[29]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Timo Aila,et al.  A Style-Based Generator Architecture for Generative Adversarial Networks , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Christophe Kolski,et al.  Adding user experience into the interactive service design loop: a persona-based approach , 2012, Behav. Inf. Technol..

[32]  Vishnu Naresh Boddeti,et al.  RankGAN: A Maximum Margin Ranking GAN for Generating Faces , 2018, ACCV.

[33]  Eric Brangier,et al.  Persona: A Method to Produce Representations Focused on Consumers’ Needs , 2011 .

[34]  Bernard J. Jansen,et al.  From 2, 772 segments to five personas: Summarizing a diverse online audience by generating culturally adapted personas , 2018, First Monday.

[35]  Bernard J. Jansen,et al.  Customer segmentation using online platforms: isolating behavioral and demographic segments for persona creation via aggregated user data , 2018, Social Network Analysis and Mining.

[36]  Steven Walczak,et al.  Comparing Semi-Automated Clustering Methods for Persona Development , 2012, IEEE Transactions on Software Engineering.

[37]  Bernard J. Jansen,et al.  Persona Perception Scale: Developing and Validating an Instrument for Human-Like Representations of Data , 2018, CHI Extended Abstracts.

[38]  Wenyi Huang,et al.  Inferring nationalities of Twitter users and studying inter-national linking , 2014, HT.

[39]  Yanbing Xue,et al.  Parsing human image by fusing semantic and spatial features: A deep learning approach , 2020, Inf. Process. Manag..

[40]  Josef Kittler,et al.  Semi-supervised Adversarial Learning to Generate Photorealistic Face Images of New Identities from 3D Morphable Model , 2018, ECCV.

[41]  Eun Go,et al.  Humanizing chatbots: The effects of visual, identity and conversational cues on humanness perceptions , 2019, Comput. Hum. Behav..

[42]  Jingwen Zhu,et al.  Talking Face Generation by Conditional Recurrent Adversarial Network , 2018, IJCAI.

[43]  Bernard J. Jansen,et al.  The Effect of Smiling Pictures on Perceptions of Personas , 2019, UMAP.

[44]  K. Gwet,et al.  A comparison of Cohen’s Kappa and Gwet’s AC1 when calculating inter-rater reliability coefficients: a study conducted with personality disorder samples , 2013, BMC Medical Research Methodology.

[45]  Yao Sun,et al.  Face Aging with Contextual Generative Adversarial Nets , 2017, ACM Multimedia.

[46]  Bernard J. Jansen,et al.  Detecting Demographic Bias in Automatically Generated Personas , 2019, CHI Extended Abstracts.

[47]  Lene Nielsen,et al.  Personas is applicable: a study on the use of personas in Denmark , 2014, CHI.

[48]  Tami Griffith,et al.  Is This Person Real? Avatar Stylization and Its Influence on Human Perception in a Counseling Training Environment , 2018, HCI.

[49]  Zengchang Qin,et al.  Auto-painter: Cartoon image generation from sketch by using conditional Wasserstein generative adversarial networks , 2018, Neurocomputing.

[50]  Theo Araujo,et al.  Living up to the chatbot hype: The influence of anthropomorphic design cues and communicative agency framing on conversational agent and company perceptions , 2018, Comput. Hum. Behav..

[51]  Patric R. Spence,et al.  Robots in the classroom: Differences in students' perceptions of credibility and learning between "teacher as robot" and "robot as teacher" , 2016, Comput. Hum. Behav..

[52]  Ainin Sulaiman,et al.  System- vs. consumer-generated recommendations: affective and social-psychological effects on purchase intention , 2019, Behav. Inf. Technol..

[53]  Nicola Marsden,et al.  Perceptions of Personas: The Role of Instructions , 2018, 2018 IEEE International Conference on Engineering, Technology and Innovation (ICE/ITMC).

[54]  Bernard J. Jansen,et al.  Are personas done? Evaluating their usefulness in the age of digital analytics , 2018, Persona Studies.

[55]  Vishal M. Patel,et al.  GP-GAN: Gender Preserving GAN for Synthesizing Faces from Landmarks , 2017, 2018 24th International Conference on Pattern Recognition (ICPR).

[56]  Bernard J. Jansen,et al.  Confusion and information triggered by photos in persona profiles , 2019, Int. J. Hum. Comput. Stud..

[57]  Steve Whittaker,et al.  How do designers and user experience professionals actually perceive and use personas? , 2012, CHI.

[58]  Hai Su,et al.  Locally and multiply distorted image quality assessment via multi-stage CNNs , 2020, Inf. Process. Manag..

[59]  Fei Gao,et al.  Incremental focal loss GANs , 2020, Inf. Process. Manag..

[60]  Lakshmi S. Iyer,et al.  Pictures tell a story: antecedents of rich-media curation in social network sites , 2019, Behav. Inf. Technol..

[61]  Bernard J. Jansen,et al.  Imaginary People Representing Real Numbers , 2018, ACM Trans. Web.

[62]  Hiroshi Ishikawa,et al.  Globally and locally consistent image completion , 2017, ACM Trans. Graph..

[63]  Bernard J. Jansen,et al.  Automatic Persona Generation (APG): A Rationale and Demonstration , 2018, CHIIR.

[64]  Chris Chapman,et al.  Quantitative Evaluation of Personas as Information , 2008 .

[65]  Jianming Dong,et al.  Getting the Most Out of Personas for Product Usability Enhancements , 2007, HCI.

[66]  Alan Cooper,et al.  The Inmates Are Running the Asylum: Why High Tech Products Drive Us Crazy and How to Restore the Sanity (2nd Edition) , 1999 .

[67]  Bernard J. Jansen,et al.  Automatic Persona Generation for Online Content Creators: Conceptual Rationale and a Research Agenda , 2019, Personas - User Focused Design.

[68]  Sercan Sengün.  Why do i fall for the elf, when i am no orc myself? The ımplıcatıons of vırtual avatars ın dıgıtal communıcatıon , 2015 .

[69]  Gregory M. P. O'Hare,et al.  Where Robots and Virtual Agents Meet , 2009, Int. J. Soc. Robotics.

[70]  Maneesh Kumar Singh,et al.  DRIT++: Diverse Image-to-Image Translation via Disentangled Representations , 2019, International Journal of Computer Vision.

[71]  Jung-Woo Ha,et al.  StarGAN: Unified Generative Adversarial Networks for Multi-domain Image-to-Image Translation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[72]  Yvonne Dittrich,et al.  Personas is not applicable: local remedies interpreted in a wider context , 2004, PDC 04.

[73]  Kari Rönkkö,et al.  An Empirical Study Demonstrating How Different Design Constraints, Project Organization and Contexts Limited the Utility of Personas , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[74]  Elaine Hicks,et al.  Human-centred design in global health: A scoping review of applications and contexts , 2017, PloS one.

[75]  David Konopnicki,et al.  Exploring the Universe of Egregious Conversations in Chatbots , 2018, IUI Companion.

[76]  Xiang Zhang,et al.  Data-driven Personas: Constructing Archetypal Users with Clickstreams and User Telemetry , 2016, CHI.

[77]  Wei Wei,et al.  COCO-GAN: Generation by Parts via Conditional Coordinating , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[78]  Erin Friess,et al.  Personas and decision making in the design process: an ethnographic case study , 2012, CHI.

[79]  Chris Chapman,et al.  The Personas' New Clothes: Methodological and Practical Arguments against a Popular Method , 2006 .

[80]  Alexei A. Efros,et al.  The Unreasonable Effectiveness of Deep Features as a Perceptual Metric , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[81]  Rishi Sharma,et al.  A Note on the Inception Score , 2018, ArXiv.

[82]  Hang Zhou,et al.  Talking Face Generation by Adversarially Disentangled Audio-Visual Representation , 2018, AAAI.

[83]  Jean-Luc Dugelay,et al.  Face aging with conditional generative adversarial networks , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[84]  Allison J. Lazard,et al.  The influence of visual complexity on initial user impressions: testing the persuasive model of web design , 2019, Behav. Inf. Technol..

[85]  Bernard J. Jansen,et al.  Data-Driven Personas for Enhanced User Understanding: Combining Empathy with Rationality for Better Insights to Analytics , 2020, Data Inf. Manag..

[86]  Alan Cooper,et al.  The Inmates are Running the Asylum , 1999, Software-Ergonomie.

[87]  Karrie Karahalios,et al.  Communicating Algorithmic Process in Online Behavioral Advertising , 2018, CHI.

[88]  Bernard J. Jansen,et al.  The Future of Data-driven Personas: A Marriage of Online Analytics Numbers and Human Attributes , 2019, ICEIS.

[89]  Sercan Sengün.  A SEMIOTIC READING OF DIGITAL AVATARS AND THEIR ROLE OF UNCERTAINTY REDUCTION IN DIGITAL COMMUNICATION , 2014 .

[90]  Elizabeth L. Cohen,et al.  Clicking for change: the role of empathy and negative affect on engagement with a charitable social media campaign* , 2019, Behav. Inf. Technol..

[91]  Shamal Faily,et al.  Persona cases: a technique for grounding personas , 2011, CHI.

[92]  Firoj Alam,et al.  CrisisMMD: Multimodal Twitter Datasets from Natural Disasters , 2018, ICWSM.