Towards a cross-cultural assessment of binge-watching: Psychometric evaluation of the "watching TV series motives" and "binge-watching engagement and symptoms" questionnaires across nine languages

Abstract In view of the growing interest regarding binge-watching (i.e., watching multiple episodes of television (TV) series in a single sitting) research, two measures were developed and validated to assess binge-watching involvement (“Binge-Watching Engagement and Symptoms Questionnaire”, BWESQ) and related motivations (“Watching TV Series Motives Questionnaire”, WTSMQ). To promote international and cross-cultural binge-watching research, the present article reports on the validation of these questionnaires in nine languages (English, French, Spanish, Italian, German, Hungarian, Persian, Arabic, Chinese). Both questionnaires were disseminated, together with additional self-report measures of happiness, psychopathological symptoms, impulsivity and problematic internet use among TV series viewers from a college/university student population (N = 12,616) in 17 countries. Confirmatory factor, measurement invariance and correlational analyses were conducted to establish structural and construct validity. The two questionnaires had good psychometric properties and fit in each language. Equivalence across languages and gender was supported, while construct validity was evidenced by similar patterns of associations with complementary measures of happiness, psychopathological symptoms, impulsivity and problematic internet use. The results support the psychometric validity and utility of the WTSMQ and BWESQ for conducting cross-cultural research on binge-watching.

[1]  Mark D. Griffiths,et al.  Do gaming motives mediate between psychiatric symptoms and problematic gaming? An empirical survey study , 2017 .

[2]  Pierre Maurage,et al.  Time for a plot twist: Beyond confirmatory approaches to binge-watching research. , 2019, Psychology of Popular Media Culture.

[3]  D. Markland.  The golden rule is that there are no golden rules: A commentary on Paul Barrett’s recommendations for reporting model fit in structural equation modelling , 2007 .

[4]  P. Maurage,et al.  Are we overpathologizing everyday life? A tenable blueprint for behavioral addiction research , 2015, Journal of behavioral addictions.

[5]  Azza Abdel-Azim Mohamed Ahmed,et al.  New Era of TV-Watching Behavior: Binge Watching and its Psychological Effects , 2017 .

[6]  Pierre Maurage,et al.  Toward a qualitative understanding of binge-watching behaviors: A focus group approach , 2017, Journal of behavioral addictions.

[7]  Pierre Maurage,et al.  Overcoming the unitary exploration of binge-watching: A cluster analytical approach , 2019, Journal of behavioral addictions.

[8]  S. Nolen-Hoeksema,et al.  Sex Differences in Depression , 1990 .

[9]  Karyn Riddle,et al.  The Addictive Potential of Television Binge Watching: Comparing Intentional and Unintentional Binges , 2017, Psychology of Popular Media Culture.

[10]  S. Lyubomirsky,et al.  A Measure of Subjective Happiness: Preliminary Reliability and Construct Validation , 1999 .

[11]  Wei-Na Lee,et al.  A Bad Habit for Your Health? An Exploration of Psychological Factors for Binge Watching Behavior , 2015 .

[12]  Michael R. Mullen,et al.  Structural equation modelling: guidelines for determining model fit , 2008 .

[13]  Sonya Dal Cin,et al.  An Experimental Examination of Binge Watching and Narrative Engagement , 2019, Social Sciences.

[14]  Satyendra C. Pandey,et al.  Binge watching and college students: motivations and outcomes , 2017 .

[15]  Lothar Mikos.  Digital Media Platforms and the Use of TV Content: Binge Watching and Video-on-Demand in Germany , 2016 .

[16]  Cheryl Campanella Bracken,et al.  Binge-Watching: A Suspenseful, Emotional, Habit , 2018, Communication Research Reports.

[17]  Gjalt-Jorn Peters,et al.  The alpha and the omega of scale reliability and validity: Why and how to abandon Cronbach’s alpha and the route towards more comprehensive assessment of scale quality , 2014 .

[18]  Daniel Kardefelt-Winther,et al.  A conceptual and methodological critique of internet addiction research: Towards a model of compensatory internet use , 2014, Comput. Hum. Behav..

[19]  Gábor Orosz,et al.  The development of the Problematic Series WatchingScale (PSWS) , 2016, Journal of behavioral addictions.

[20]  Daniel Kardefelt-Winther,et al.  Commentary on: Are we overpathologizing everyday life? A tenable blueprint for behavioral addiction research , 2015, Journal of behavioral addictions.

[21]  M. Potenza,et al.  Gender-related differences in addiction: a review of human studies , 2018, Current Opinion in Behavioral Sciences.

[22]  Tibert Verhagen,et al.  Binge-watching Serialized Video Content: A Transdisciplinary Review , 2019, Television & New Media.

[23]  Anjum Naweed,et al.  Do coping strategies moderate the relationship between escapism and negative gaming outcomes in World of Warcraft (MMORPG) players? , 2018, Comput. Hum. Behav..

[24]  John Hunsley,et al.  A Guide to Assessments That Work , 2008 .

[25]  Gábor Orosz,et al.  Connected to TV series: Quantifying series watching engagement , 2017, Journal of behavioral addictions.

[26]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[27]  Adriano Schimmenti,et al.  Selfitis, selfie addiction, Twitteritis: Irresistible appeal of medical terminology for problematic behaviours in the digital age , 2018, The Australian and New Zealand journal of psychiatry.

[28]  Johan F. Hoorn,et al.  Some Like It Bad: Testing a Model for Perceiving and Experiencing Fictional Characters , 2005 .

[29]  Srikumar Ramayan,et al.  The Effects of Binge Watching on Interpersonal Communication among Department of Communication and Liberal Arts (DCLA) Students , 2018 .

[30]  William Revelle,et al.  Cronbach’s α, Revelle’s β, and Mcdonald’s ωH: their relations with each other and two alternative conceptualizations of reliability , 2005 .

[31]  E. Frank,et al.  Adolescent onset of the gender difference in lifetime rates of major depression: a theoretical model. , 2000, Archives of general psychiatry.

[32]  Karl G. Jöreskog,et al.  Lisrel 8: Structural Equation Modeling With the Simplis Command Language , 1993 .

[33]  Dolf Zillmann,et al.  Mechanisms of emotional involvement with drama , 1995 .

[34]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[35]  Richard M. Ryan,et al.  “I Can’t Wait for the Next Episode!” Investigating the Motivational Pull of Television Dramas Through the Lens of Self-Determination Theory , 2017 .

[36]  Yi Liu,et al.  Excessive use of online video streaming services: Impact of recommender system use, psychological factors, and motives , 2018, Comput. Hum. Behav..

[37]  K. Schermelleh-Engel,et al.  Evaluating the Fit of Structural Equation Models: Tests of Significance and Descriptive Goodness-of-Fit Measures. , 2003 .

[38]  P. Maurage,et al.  How can we conceptualize behavioural addiction without pathologizing common behaviours? , 2017, Addiction.

[39]  A. Rubin.  The uses-and-gratifications perspective of media effects. , 2002 .

[40]  John G. Cull,et al.  To Binge or Not To Binge , 1999 .

[41]  J. Mitchell Vaterlaus,et al.  College student television binge watching: Conceptualization, gratifications, and perceived consequences , 2019 .

[42]  Rob Samuels,et al.  Media marathoning: Immersions in morality , 2017, New Media Soc..

[43]  Alaina Kramer.  Screening for Sleep Problems: Binge Watching in the Internet Era and its Relationship to Sleep Habits , 2015 .

[44]  C. Bombardier,et al.  Guidelines for the process of cross-cultural adaptation of self-report measures. , 2000, Spine.

[45]  E. Katz,et al.  Uses and Gratifications Research , 2019, The International Encyclopedia of Journalism Studies.

[46]  Norman J. Medoff,et al.  The Effect of Affective States on Selective Exposure to Televised Entertainment Fare1 , 1980 .

[47]  Stephan U Dombrowski,et al.  ‘Just one more episode’: Frequency and theoretical correlates of television binge watching , 2018, Journal of health psychology.

[48]  K. Oatley.  A taxonomy of the emotions of literary response and a theory of identification in fictional narrative , 1995 .

[49]  Sidneyeve Matrix,et al.  The Netflix Effect: Teens, Binge Watching, and On-Demand Digital Media Trends , 2014, Jeunesse: Young People, Texts, Cultures.

[50]  Jiaji Wang,et al.  Prevalence of internet addiction and its association with stressful life events and psychological symptoms among adolescent internet users. , 2014, Addictive behaviors.

[51]  Elly A. Konijn,et al.  Spotlight on spectators; emotions in the theater , 1999 .

[52]  Bridget Rubenking,et al.  Go Long or Go Often: Influences on Binge Watching Frequency and Duration among College Students , 2019, Social Sciences.

[53]  Jeanne H. Brockmyer,et al.  The Development of the Game Engagement Questionnaire: A Measure of Engagement in Video Game Playing: Response to Reviews , 2009, Interacting with computers.

[54]  Vassilis-Javed Khan,et al.  Confessions of A 'Guilty' Couch Potato Understanding and Using Context to Optimize Binge-watching Behavior , 2016, TVX.

[55]  J. Van den Bulck,et al.  Binge Viewing, Sleep, and the Role of Pre-Sleep Arousal. , 2017, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[56]  Jessica Sloan Kruger.  Looking into Screen Time: Mental Health and Binge Watching , 2015 .

[57]  Kim Sheehan,et al.  Sprinting a media marathon: Uses and gratifications of binge-watching television through Netflix , 2015, First Monday.

[58]  Marc J Gunter,et al.  Physical activity, sedentary behaviour and colorectal cancer risk in the UK Biobank , 2018, British Journal of Cancer.

[59]  Leonard Reinecke,et al.  Binge-Watching and Psychological Well-Being: Media Use Between Lack of Control and Perceived Autonomy , 2018, Communication Research Reports.

[60]  Edward E. Rigdon,et al.  CFI versus RMSEA: A comparison of two fit indexes for structural equation modeling , 1996 .

[61]  Jolanta A Starosta,et al.  Characteristics of people’s binge-watching behavior in the “entering into early adulthood” period of life , 2019, Health Psychology Report.

[62]  Arnaud Carré,et al.  Validation of a short French version of the UPPS-P Impulsive Behavior Scale. , 2012, Comprehensive psychiatry.

[63]  Richard P. Bagozzi,et al.  Specification, evaluation, and interpretation of structural equation models , 2012 .

[64]  Dan J Stein,et al.  High Involvement Versus Pathological Involvement in Video Games: a Crucial Distinction for Ensuring the Validity and Utility of Gaming Disorder , 2019, Current Addiction Reports.

[65]  S. Finney.  Nonnormal and categorical data in structural equation modeling , 2013 .

[66]  Cary W. Horvath,et al.  Measuring Television Addiction , 2004 .

[67]  Mary Cushman,et al.  TV viewing and incident venous thromboembolism: the Atherosclerotic Risk in Communities Study , 2018, Journal of Thrombosis and Thrombolysis.

[68]  P. Albert,et al.  Why is depression more prevalent in women? , 2015, Journal of psychiatry & neuroscience : JPN.

[69]  Sujin Lee,et al.  Internet Over-Users' Psychological Profiles: A Behavior Sampling Analysis on Internet Addiction , 2003, Cyberpsychology Behav. Soc. Netw..

[70]  Robert J. Vallerand,et al.  The Psychology of Passion: A Dualistic Model , 2015 .

[71]  Alec C. Tefertiller,et al.  Depression, emotional states, and the experience of binge-watching narrative television , 2018, Atlantic Journal of Communication.

[72]  D. A. Kenny,et al.  Effect of the Number of Variables on Measures of Fit in Structural Equation Modeling , 2003 .

[73]  Geneviève A. Mageau,et al.  Les passions de l'ame: on obsessive and harmonious passion. , 2003, Journal of personality and social psychology.

[74]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[75]  J. Hair.  Multivariate data analysis : a global perspective , 2010 .

[76]  Douglas A. Gentile,et al.  Pathological Technology Addictions: What Is Scientifically Known and What Remains to Be Learned , 2012 .

[77]  Silvia Knobloch-Westerwick,et al.  Choice and Preference in Media Use : Advances in Selective Exposure Theory and Research , 2014 .

[78]  Cheryl Campanella Bracken,et al.  Defining new viewing behaviours: What makes and motivates TV binge-watching? , 2018 .

[79]  Keren Eyal,et al.  The Psychology of Marathon Television Viewing: Antecedents and Viewer Involvement , 2018 .

[80]  Peter M. Bentler,et al.  EQS : structural equations program manual , 1989 .

[81]  Ki Joon Kim,et al.  An exploration of the motivations for binge-watching and the role of individual differences , 2018, Comput. Hum. Behav..

[82]  Regina J. J. M. van den Eijnden,et al.  The Compulsive Internet Use Scale (CIUS): Some Psychometric Properties , 2009, Cyberpsychology Behav. Soc. Netw..

[83]  Nick Yee,et al.  Motivations for Play in Online Games , 2006, Cyberpsychology Behav. Soc. Netw..

[84]  R. Tunney,et al.  The need for a behavioural analysis of behavioural addictions. , 2017, Clinical psychology review.

[85]  Kun Xu,et al.  Binge-watching motivates change: Uses and gratifications of streaming video viewers challenge traditional TV research , 2020 .

[86]  M. Hautzinger.  [Sex differences in depression]. , 1991, Zeitschrift fur klinische Psychologie, Psychopathologie und Psychotherapie.

[87]  John P. Charlton,et al.  Distinguishing addiction and high engagement in the context of online game playing , 2007, Comput. Hum. Behav..

[88]  Cynthia A. Hoffner,et al.  Young Adults' Wishful Identification With Television Characters: The Role of Perceived Similarity and Character Attributes , 2005 .

[89]  Hongjin Shim,et al.  I hate binge-watching but I can't help doing it: The moderating effect of immediate gratification and need for cognition on binge-watching attitude-behavior relation , 2018, Telematics Informatics.

[90]  P. Maurage,et al.  Passion or addiction? Correlates of healthy versus problematic use of videogames in a sample of French-speaking regular players. , 2018, Addictive behaviors.

[91]  Wei-Na Lee,et al.  Why Do We Indulge? Exploring Motivations for Binge Watching , 2018, Journal of Broadcasting & Electronic Media.

[92]  Pierre Maurage,et al.  Assessing binge-watching behaviors: Development and validation of the "Watching TV Series Motives" and "Binge-watching Engagement and Symptoms" questionnaires , 2019, Comput. Hum. Behav..

[93]  John P. Charlton,et al.  Validating the distinction between computer addiction and engagement: online game playing and personality , 2010, Behav. Inf. Technol..

[94]  Gábor Orosz,et al.  Tóth-Király et al. (2019) - Two sides of the same coin: The differentiating role of need satisfaction and frustration in passion for screen-based activities , 2019 .

[95]  F. Chen.  Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance , 2007 .

[96]  Robert J. Vallerand,et al.  On the correlates of passion for screen-based behaviors: The case of impulsivity and the problematic and non-problematic Facebook use and TV series watching , 2016 .

[97]  A. Rubin.  Television uses and gratifications: The interactions of viewing patterns and motivations , 1983 .

[98]  Pierre Maurage,et al.  Binge-Watching: What Do we Know So Far? A First Systematic Review of the Evidence , 2020, Current Addiction Reports.