Design recommendations for augmenting creative tasks with computational priming

Supporting creativity is a grand challenge in HCI. A critical component of creativity is the ability for divergent thinking, and divergent thinking can be fostered through looking at the problem through the lens of a different person, by assuming a role. Prior work found that assuming a role and affective stimulation with images may lead individuals to be more creative. In this work, we investigate the use of roles in stimulating the creativity of individuals in two complementary studies. In the first study, we implemented an online instrument for augmenting creativity with roles and images, and recruited crowd workers (n = 60) to complete a divergent thinking task while assuming a role. Interestingly, and in contrast to earlier findings, our analysis could not confirm the computational priming having an effect on the outcome of a small batch of creative tasks. In the second study, we observed the effect of roles on the ideation process of individuals when they reach an impasse in the flow of ideas. Our complementary studies highlight that adopting roles can help when one runs out of ideas, but this is not a silver bullet for improving divergent thinking, especially in online crowd-sourcing environments that are increasingly being used for experiments and data collection in behavioural science. Our work informs the design of future crowd-powered creativity support tools and contributes a timely case study to the body of literature in the growing field of creativity support online.

[1]  H. Pashler,et al.  Measuring the Crowd Within , 2008, Psychological science.

[2]  Michael Vitale,et al.  The Wisdom of Crowds , 2015, Cell.

[3]  Aniket Kittur,et al.  Crowdsourcing user studies with Mechanical Turk , 2008, CHI.

[4]  Teresa M. Amabile,et al.  How to kill creativity. , 1998, Harvard business review.

[5]  Gianluca Demartini,et al.  Pick-a-crowd: tell me what you like, and i'll tell you what to do , 2013, CIDR.

[6]  Daniel M. Oppenheimer,et al.  Instructional Manipulation Checks: Detecting Satisficing to Increase Statistical Power , 2009 .

[7]  Ben Shneiderman,et al.  Creativity support tools , 2002, CACM.

[8]  Richard P. Larrick,et al.  The wisdom of select crowds. , 2014, Journal of personality and social psychology.

[9]  Katharina Reinecke,et al.  Pay Attention, Please: Formal Language Improves Attention in Volunteer and Paid Online Experiments , 2019, CHI.

[10]  Derek Ruths,et al.  How One Microtask Affects Another , 2016, CHI.

[11]  Andruid Kerne,et al.  Everyday ideation: all of my ideas are on pinterest , 2014, CHI.

[12]  Aniket Kittur,et al.  Searching for analogical ideas with crowds , 2014, CHI.

[13]  Sebastian Möller,et al.  Crowdsourcing Versus the Laboratory: Towards Human-Centered Experiments Using the Crowd , 2017, Crowdsourcing and Human-Centered Experiments.

[14]  Alwin de Rooij,et al.  Being Yourself to be Creative: How Self-Similar Avatars can Support the Generation of Original Ideas in Virtual Environments , 2019, Creativity & Cognition.

[15]  Celine Latulipe,et al.  Creativity factor evaluation: towards a standardized survey metric for creativity support , 2009, C&C '09.

[16]  Dana Chandler,et al.  Breaking Monotony with Meaning: Motivation in Crowdsourcing Markets , 2012, ArXiv.

[17]  Elizabeth Gerber,et al.  Affective computational priming and creativity , 2011, CHI.

[18]  Aniket Kittur,et al.  Encouraging “Outside- the- box” Thinking in Crowd Innovation Through Identifying Domains of Expertise , 2016, CSCW.

[19]  H. Sebastian Seung,et al.  A solution to the single-question crowd wisdom problem , 2017, Nature.

[20]  Peter Dalsgaard,et al.  Mapping the Landscape of Creativity Support Tools in HCI , 2019, CHI.

[21]  Stefan Dietze,et al.  A taxonomy of microtasks on the web , 2014, HT.

[22]  Elizabeth Gerber,et al.  Priming for Better Performance in Microtask Crowdsourcing Environments , 2012, IEEE Internet Computing.

[23]  Anind K. Dey,et al.  Understanding and Using Context , 2001, Personal and Ubiquitous Computing.

[24]  I. Ajzen.  The theory of planned behavior , 1991 .

[25]  David J. Shernoff,et al.  Optimal Learning Environments to Promote Student Engagement , 2013 .

[26]  Ben Shneiderman,et al.  Creativity support tools: accelerating discovery and innovation , 2007, CACM.

[27]  Terry Bossomaier,et al.  The creativity quotient: An objective scoring of ideational fluency , 2004 .

[28]  M. Couper.  A REVIEW OF ISSUES AND APPROACHES , 2000 .

[29]  Kim A. Hoffman,et al.  Introducing Dyadic Interviews as a Method for Collecting Qualitative Data , 2013, Qualitative health research.

[30]  Adam Marcus,et al.  The Effects of Sequence and Delay on Crowd Work , 2015, CHI.

[31]  A. Allport,et al.  Task switching and the measurement of “switch costs” , 2000, Psychological research.

[32]  Anna L. Cox,et al.  Monotasking or Multitasking: Designing for Crowdworkers' Preferences , 2019, CHI.

[33]  Jorge Gonçalves,et al.  DC2S2: Designing Crowd-powered Creativity Support Systems , 2019, CHI Extended Abstracts.

[34]  Jesse Chandler,et al.  Nonnaïveté among Amazon Mechanical Turk workers: Consequences and solutions for behavioral researchers , 2013, Behavior Research Methods.

[35]  Jeffrey V. Nickerson,et al.  A literature review on individual creativity support systems , 2017, Comput. Hum. Behav..

[36]  Krzysztof Z. Gajos,et al.  Providing Timely Examples Improves the Quantity and Quality of Generated Ideas , 2015, Creativity & Cognition.

[37]  Laura A. Dabbish,et al.  Fruitful Feedback: Positive Affective Language and Source Anonymity Improve Critique Reception and Work Outcomes , 2017, CSCW.

[38]  John T. Willse,et al.  Assessing Creativity With Divergent Thinking Tasks: Exploring the Reliability and Validity of New Subjective Scoring Methods , 2008 .

[39]  Gregory D. Abowd,et al.  Towards a Better Understanding of Context and Context-Awareness , 1999, HUC.

[40]  Craig A. Anderson,et al.  The MTurkification of Social and Personality Psychology , 2018, Personality & social psychology bulletin.

[41]  Richard P. Larrick,et al.  The social psychology of the wisdom of crowds. , 2012 .

[42]  T. B. Ward.  Structured Imagination: the Role of Category Structure in Exemplar Generation , 1994, Cognitive Psychology.

[43]  G. Clore,et al.  Emotional role playing, attitude change, and attraction toward a disabled person. , 1972, Journal of personality and social psychology.

[44]  Randall K. Minas,et al.  Sparking Creativity: Improving Electronic Brainstorming with Individual Cognitive Priming , 2013 .

[45]  B. Schwartz.  The Paradox of Choice: Why More Is Less , 2004 .

[46]  Jaime Teevan,et al.  Chain Reactions: The Impact of Order on Microtask Chains , 2016, CHI.

[47]  Katharina Reinecke,et al.  Framing Effects , 2018, Proc. ACM Hum. Comput. Interact..

[48]  Chris Callison-Burch,et al.  A Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turk , 2017, CHI.

[49]  Astrid Reichel,et al.  The Effects of IT-Enabled Cognitive Stimulation Tools on Creative Problem Solving: A Dual Pathway to Creativity , 2016, J. Manag. Inf. Syst..

[50]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[51]  Alwin de Rooij,et al.  The Creative Proteus Effect: How Self-Similarity, Embodiment, and Priming of Creative Stereotypes with Avatars Influences Creative Ideation , 2017, Creativity & Cognition.

[52]  Felipe A. Csaszar,et al.  Organizational Decision Making: An Information Aggregation View , 2012, Manag. Sci..

[53]  Richard P. Larrick,et al.  Intuitions About Combining Opinions: Misappreciation of the Averaging Principle , 2006, Manag. Sci..

[54]  Boualem Benatallah,et al.  Quality Control in Crowdsourcing , 2018, ACM Comput. Surv..

[55]  A. Acquisti,et al.  Beyond the Turk: Alternative Platforms for Crowdsourcing Behavioral Research , 2016 .

[56]  Gloria Mark,et al.  The cost of interrupted work: more speed and stress , 2008, CHI.

[57]  Jorge Gonçalves,et al.  Crowd-powered Interfaces for Creative Design Thinking , 2019, Creativity & Cognition.

[58]  Michael A. Terry,et al.  Creativity Support Tool Evaluation Methods and Metrics , 2005 .

[59]  Giulio Jacucci,et al.  Crowdboard: Augmenting In-Person Idea Generation with Real-Time Crowds , 2017, Creativity & Cognition.

[60]  Stefan M. Herzog,et al.  The Wisdom of Many in One Mind , 2009, Psychological science.

[61]  R. Weisberg.  Creativity: Understanding Innovation in Problem Solving, Science, Invention, and the Arts , 2006 .

[62]  Krzysztof Z. Gajos,et al.  Semantically Far Inspirations Considered Harmful?: Accounting for Cognitive States in Collaborative Ideation , 2017, Creativity & Cognition.

[63]  Jaime Teevan,et al.  Bringing the Wisdom of the Crowd to an Individual by Having the Individual Assume Different Roles , 2017, Creativity & Cognition.

[64]  Alan R. Dennis,et al.  Electronic brainstorming: Theory, research, and future directions. , 2003 .

[65]  E. Hippel,et al.  Customers As Innovators: A New Way to Create Value , 2002 .

[66]  Aniket Kittur,et al.  Crowdsourcing, collaboration and creativity , 2010, XRDS.

[67]  Jodi Asbell-Clarke,et al.  Challenging games help students learn: An empirical study on engagement, flow and immersion in game-based learning , 2016, Comput. Hum. Behav..

[68]  T. M. Amabile.  The social psychology of creativity: A componential conceptualization. , 1983 .