That's a Rap - Increasing Engagement with Rap Music Performance by Virtual Agents

Many applications of virtual agents, including those in healthcare and education, require engaging users in dozens or hundreds of interactions over long periods of time. In this effort, we are developing conversational agents to engage young adults in longitudinal lifestyle health behavior change interventions. Hip-hop and rap are one of the most popular genres of music among our stakeholders, and we are exploring rap as an engagement mechanism and communication channel in our agent-based interventions. We describe a method for integrating rap into a counseling dialog by a conversational agent, including the acoustic manipulation of synthetic speech and accompanying character dance animation. We demonstrate in a within-subjects study that the participants who like rap music preferred the rapping character significantly more than an equivalent agent that does not rap in its dialog, based on both self-report and behavioral measures. Participants also found the rapping agent significantly more engaging than the non-rapping one.

[1]  Edgar H. Tyson Rap-music Attitude and Perception Scale: A Validation Study , 2006 .

[2]  Lawrence R. Wheeless,et al.  THE MEASUREMENT OF TRUST AND ITS RELATIONSHIP TO SELF‐DISCLOSURE , 1977 .

[3]  Tatsuya Kawahara,et al.  Recent Development of Open-Source Speech Recognition Engine Julius , 2009 .

[4]  Shuo Zhou,et al.  Agent-User Concordance and Satisfaction with a Virtual Hospital Discharge Nurse , 2014, IVA.

[5]  N. Harris,et al.  Using rap music to promote adolescent health: pilot study of VoxBox. , 2015, Health promotion journal of Australia : official journal of Australian Association of Health Promotion Professionals.

[6]  Timothy Bickmore,et al.  Increasing the Engagement of Conversational Agents through Co-Constructed Storytelling , 2015, INT/SBG@AIIDE.

[7]  Anton Nijholt,et al.  Virtual rap dancer: invitation to dance , 2006, CHI Extended Abstracts.

[8]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[9]  D. Elligan Rap therapy: A culturally sensitive approach to psychotherapy with young african american men , 2000 .

[10]  E. Hockman,et al.  RAP Therapy: A Group Work Intervention Method for Urban Adolescents , 2004 .

[11]  Geetanjali R. Kamath,et al.  An entertainment‐education colorectal cancer screening decision aid for African American patients: A randomized controlled trial , 2016, Cancer.

[12]  J. Fisher,et al.  A music-based HIV prevention intervention for urban adolescents. , 2008, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[13]  Tapani Raiko,et al.  DopeLearning: A Computational Approach to Rap Lyrics Generation , 2015, KDD.

[14]  Maurizio Mancini,et al.  A Virtual Head Driven by Music Expressivity , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[15]  Justine Cassell,et al.  BEAT: the Behavior Expression Animation Toolkit , 2001, Life-like characters.

[16]  T. Page,et al.  Song to Self: Promoting a Therapeutic Dialogue with High-Risk Youths Through Poetry and Popular Music , 2012 .

[17]  Brigitte Bigi,et al.  SPPAS: a tool for the phonetic segmentation of speech , 2012, LREC.

[18]  Anton Nijholt,et al.  Temporal interaction between an artificial orchestra conductor and human musicians , 2008, CIE.

[19]  Timothy W. Bickmore,et al.  Increasing Engagement with Virtual Agents Using Automatic Camera Motion , 2016, IVA.

[20]  Timothy W. Bickmore,et al.  MAINTAINING ENGAGEMENT IN LONG-TERM INTERVENTIONS WITH RELATIONAL AGENTS , 2010, Appl. Artif. Intell..

[21]  Hip hop and spoken word therapy with urban youth , 2012 .