Measuring Subjective Movie Evaluation Criteria: Conceptual Foundation, Construction, and Validation of the SMEC Scales

ABSTRACT Audiences’ movie evaluations have often been explored as effects of experiencing movies. However, little attention has been paid to the criteria viewers use when they evaluate a movie or its specific features. Adding to this, the present research introduces the idea of subjective movie evaluation criteria (SMEC), conceptualizes SMEC as the mental representation of important attitudes toward specific film features, and describes the scale construction for their measurement and its validation process. Findings from pilot work and 2 studies including over 1,500 participants provide first evidence that 8 dimensions—Story Verisimilitude, Story Innovation, Cinematography, Special Effects, Recommendation, Innocuousness, Light-heartedness, and Cognitive Stimulation—are largely determined by stable individual differences, substantially but differentially related to film-specific constructs and personality traits, and that the SMEC scales are reliable and valid instruments for measuring subjective movie evaluation criteria.

[1]  Allègre L. Hadida,et al.  Motion Picture Performance: A Review and Research Agenda , 2009 .

[2]  Skip Dine Young Psychology at the Movies: Young/Psychology at the Movies , 2012 .

[3]  B. Gunter An Audience-Based Approach to Assessing Programme Quality , 1997 .

[4]  A. d’Astous,et al.  Consumer evaluations of movies on the basis of critics' judgments , 1999 .

[5]  P. Valkenburg,et al.  Differential Susceptibility to Media Effects Model , 2013, The International Encyclopedia of Media Psychology.

[6]  Arthur A. Raney,et al.  Entertainment as Pleasurable and Meaningful: Identifying Hedonic and Eudaimonic Motivations for Entertainment Consumption , 2011 .

[7]  Silvia Knobloch-Westerwick,et al.  Choice and Preference in Media Use : Advances in Selective Exposure Theory and Research , 2014 .

[8]  R. Kline Principles and practice of structural equation modeling, 3rd ed. , 2011 .

[9]  Christoph Klimmt,et al.  Implicit Measures and Media Effects Research: Challenges and Opportunities , 2011 .

[10]  Penny S. Visser,et al.  Attitude Importance: Understanding the Causes and Consequences of Passionately Held Views , 2008 .

[11]  Holger Schramm,et al.  Exploring the paradox of sad-film enjoyment: The role of multiple appraisals and meta-appraisals , 2010 .

[12]  Niels G. Waller,et al.  Exploring personality through test construction: Development of the multidimensional personality questionnaire , 2008 .

[13]  Noël Carroll Engaging the Moving Image , 2017 .

[14]  Rolf Steyer,et al.  Latent state-trait models. , 2012 .

[15]  Matthias Burisch,et al.  Approaches to personality inventory construction: A comparison of merits. , 1984 .

[16]  J. Igartua,et al.  Hedonic and eudaimonic motives for watching feature films. Validation of the Spanish version of Oliver – Raney’s scale , 2013 .

[17]  A. Tellegen,et al.  PERSONALITY PROCESSES AND INDIVIDUAL DIFFERENCES An Alternative "Description of Personality": The Big-Five Factor Structure , 2022 .

[18]  P. Nikken,et al.  Children's Views on Quality Standards for Children's Television Programs , 1997 .

[19]  Robert O. Wyatt,et al.  Effects of Information and Evaluation in Film Criticism , 1990 .

[20]  M. Salo,et al.  Identifiability at the boundary for first-order terms , 2006 .

[21]  Benjamin K. Johnson,et al.  Who’s afraid of spoilers? Need for cognition, need for affect, and narrative selection and enjoyment , 2016 .

[22]  M. Browne An Overview of Analytic Rotation in Exploratory Factor Analysis , 2001 .

[23]  Frank M. Schneider,et al.  Measuring Traits and States in Public Opinion Research: A Latent State–Trait Analysis of Political Efficacy , 2014 .

[24]  Seth Finn,et al.  Origins of Media Exposure , 1997 .

[25]  Phil Wood Confirmatory Factor Analysis for Applied Research , 2008 .

[26]  Tilo Hartmann The Effect of Subjective Quality Assessments on Media Selection JENS WOLLING , 2009 .

[27]  Julia K. Woolley,et al.  Entertainment We Watch and Entertainment We Appreciate: Patterns of Motion Picture Consumption and Acclaim Over Three Decades , 2014 .

[28]  B. Oliver,et al.  Individual Differences in Media Effects , 2002 .

[29]  Robin L. Nabi,et al.  The Sage handbook of media processes and effects , 2009 .

[30]  D. Zillmann Mood Management Through Communication Choices , 1988 .

[31]  Ron Tamborini,et al.  Testing a Dual-Process Model of Media Enjoyment and Appreciation , 2014 .

[32]  P. Costa,et al.  NEO inventories for the NEO Personality Inventory-3 (NEO-PI-3), NEO Five-Factor Inventory-3 (NEO-FFI-3), NEO Personality Inventory-Revised (NEO PI-R) : professional manual , 2010 .

[33]  Patti M. Valkenburg,et al.  What do children value in entertainment programs? A cross-cultural investigation , 1999 .

[34]  Peter Vorderer,et al.  Does Entertainment Suffer From Interactivity? The Impact of Watching an Interactive TV Movie on Viewers' Experience of Entertainment , 2001 .

[35]  Ruud S. Jacobs,et al.  Everyone's a critic: The power of expert and consumer reviews to shape readers' post-viewing motion picture evaluations , 2015 .

[36]  Raymond B. Cattell,et al.  Psychological Theory and Scientific Method , 1988 .

[37]  Anne S. Hsu,et al.  What Type of Movie Person are You , 2013 .

[38]  Frank M. Schneider,et al.  Entertainment and Politics Revisited: How Non-Escapist Forms of Entertainment Can Stimulate Political Interest and Information Seeking , 2014 .

[39]  Marina Krcmar,et al.  Uses and Gratifications of Media Violence: Personality Correlates of Viewing and Liking Violent Genres , 2005 .

[40]  P. Vorderer,et al.  Appraisal of Emotions in Media Use: Toward a Process Model of Meta-Emotion and Emotion Regulation , 2008 .

[41]  Helmut Leder,et al.  Art expertise: a study of concepts and conceptual spaces , 2006 .

[42]  Michael Scharkow,et al.  Modes of reception for fictional films , 2009 .

[43]  Silvia Knobloch-Westerwick,et al.  Murder for Pleasure , 2008, J. Media Psychol. Theor. Methods Appl..

[44]  Robert J. Lewis,et al.  Media Enjoyment as Need Satisfaction: The Contribution of Hedonic and Nonhedonic Needs , 2011 .

[45]  M. Zuckerman Sensation Seeking : Beyond the Optimal Level of Arousal , 1979 .

[46]  Skip Dine Young Psychology at the Movies , 2012 .

[47]  James B. Weaver,et al.  Exploring the links between personality and media preferences , 1991 .

[48]  P. Nikken,et al.  Maternal Quality Standards for Children's Television Programs , 1996 .

[49]  P. Silvia,et al.  Finding Movies Interesting: How Appraisals and Expertise Influence the Aesthetic Experience of Film , 2011 .

[50]  K. Möller,et al.  Role of motives and attributes in consumer motion picture choice , 1983 .

[51]  A. Tesser,et al.  On the Perceived Functions of Movies , 1988 .

[52]  Gerd Bohner,et al.  Need for cognition: eine Skala zur Erfassung von Engagement und Freude bei Denkaufgaben , 1991 .

[53]  Bruce Austin,et al.  Motivations for movie attendance , 1986 .

[54]  P. Costa,et al.  The revised NEO personality inventory (NEO-PI-R) , 2008 .

[55]  M. Oliver,et al.  Appreciation as Audience Response: Exploring Entertainment Gratifications beyond Hedonism. , 2010 .

[56]  S. Stieger,et al.  The disinterested play of thought: Individual differences and preference for surrealist motion pictures. , 2010 .

[57]  Klaus R. Scherer,et al.  The Nature and Dynamics of Relevance and Valence Appraisals: Theoretical Advances and Recent Evidence , 2013 .

[58]  R. Hoyle,et al.  Reliability and validity of a brief measure of sensation seeking , 2002 .

[59]  J. Wolling Qualitätserwartungen, Qualitätswahrnehmungen und die Nutzung von Fernsehserien , 2004 .

[60]  T. Raykov Estimation of Composite Reliability for Congeneric Measures , 1997 .

[61]  J. Cacioppo,et al.  The need for cognition. , 1982 .

[62]  M. Holbrook Popular Appeal versus Expert Judgments of Motion Pictures , 1999 .

[63]  Dean Keith Simonton,et al.  Cinematic success criteria and their predictors: The art and business of the film industry. , 2009 .

[64]  A. Satorra,et al.  Corrections to test statistics and standard errors in covariance structure analysis. , 1994 .

[65]  Mark Wilson,et al.  Constructing Measures: An Item Response Modeling Approach , 2004 .

[66]  P. M. Valkenburg,et al.  Children's likes and dislikes in entertainment programs. , 2000 .

[67]  S. Gosling,et al.  Construct Validation of a short Five-Factor Model Instrument: A Self-Peer Study on the German Adaptation of the Ten-Item Personality Inventory (TIPI-G). , 2007 .

[68]  P. Vorderer,et al.  Enjoyment: At the Heart of Media Entertainment , 2004 .

[69]  W. Wirth,et al.  Beyond pleasure: Exploring the eudaimonic entertainment experience. , 2012 .

[70]  Duane T. Wegener,et al.  Evaluating the use of exploratory factor analysis in psychological research. , 1999 .

[71]  J. Krosnick,et al.  The causes and consequences of attitude importance. , 1995 .

[72]  Bertram Gawronski EDITORIAL: ATTITUDES CAN BE MEASURED! BUT WHAT IS AN ATTITUDE? , 2007 .

[73]  D. L. Swanson,et al.  Gratification seeking, media exposure, and audience interpretations: Some directions for research , 1987 .

[74]  D. Jain,et al.  Consumer Choice Process for Experience Goods: An Econometric Model and Analysis , 1999 .

[75]  Ran D. Zilca,et al.  Listening, watching, and reading: the structure and correlates of entertainment preferences. , 2011, Journal of personality.

[76]  Peter M. Bentler,et al.  EQS : structural equations program manual , 1989 .

[77]  Manfred J. Schmitt,et al.  The effects of aggregation across and within occasions on consistency, specificity and reliability. , 1990 .