Mind-based media and communications technologies. How the form of symbolical information influences felt meaning

The problem of the study is the design of modern, computerized mediaand communication technologies which systematically influence subjective experiences and knowledge of the perceivers. The interaction of mind and the information embedded in modern media and communications technologies is complex. The result of this interaction is the making of meaning for information. There are sources of variability of meaning in the perceiver and media and communications technologies. These sources of variability partly determine the resulting meanings which are made. Meaning may instantly change subjective experience, such as emotion, and change knowledge. By semi-systematically controlling the making of meaning, one may indirectly influence subjective experience and change the knowledge of a certain perceiver. This happens by manipulating the information embedded in a particular media and communications technology to reach a certain goal, such as to produce a subjective experience or change knowledge via influencing meanings in a certain way. This study focuses on the influence of the way of designing and presenting information on non-linguistic, presentational and image-schematic meanings and the consequent changes in subjective experience and/or knowledge of the perceiver. As a result of theoretical and conceptual elaborations the study presents an approach to the design of mind-based media and communications technologies. To describe the problem area the study constructs models of making meaning. Making meaning in a real, physical environment is influenced by complex interactions of the perceiver, the object of perception and the context of perception. An object of perception is perceived via attention, which relegates the other objects of perception to the background, or context. Meaning is made in unconscious processes via three interacting loops of processing. In the perception-action loop, the sensory mechanisms resonate with the features of the object of perception, reflecting the embeddedness of the perceiver in the context. In the attention loop some sensory representations produced in the perception-action loop are identified and quickly categorized by projecting non-linguistic symbolic models, such as primary metaphors, onto the sensory representations. This results in non-linguistic, image-schematic and presentational felt meaning. It may also be the basis of personal meaning, which is based on the unconscious evaluation of the immediate relevance of the object of perception to personal values, ego, goals and well-being. Felt and personal meaning may directly influence subjective experiences, such as emotion, due to the close link of emotion and cognition. Partly similar mechanisms of change may apply to other types of subjective experience, such as daydreaming or flow. In a further-processing loop, meaning is made via more elaborated comparisons of mental representations and previous knowledge. This may lead to knowledge construction, accumulative and mechanistic change in knowledge. It may also lead to knowledge creation, which implies the change of levels of meaning in knowledge. Also, subjective experiences may be altered. When perceiving information via media and communications technologies, the mind is psychologically transported into a quasi-natural experience of the events described. This is called presence. In presence, information becomes the focused object of perception, while the immediate, external context, including the technological device, fades into the background. Various empirical studies show that information experienced in presence has real psychological effects on perceivers and

[1]  Randolph R. Cornelius,et al.  The science of emotion: Research and tradition in the psychology of emotion. , 1997 .

[2]  J. Bargh Conditional automaticity: Varieties of automatic influence in social perception and cognition. , 1989 .

[3]  L. Festinger,et al.  A Theory of Cognitive Dissonance , 2017 .

[4]  Walter J. Ong,et al.  Interfaces of the Word: Studies in the Evolution of Consciousness and , 1979 .

[5]  P. Gollwitzer Action phases and mind-sets , 1990 .

[6]  G. Salomon Interaction of media, cognition and learning , 1979 .

[7]  Arie W. Kruglanski,et al.  Goals as knowledge structures. , 1996 .

[8]  N. D. Batra A Self-Renewing Society: The Role of Television and Communications Technology , 1990 .

[9]  John H. Flavell,et al.  Do young children think of television images as pictures or real objects , 1990 .

[10]  Nigel Gilbert,et al.  Research, Theory and Method , 2001 .

[11]  Samuel D. Guttenplan,et al.  A Companion to the Philosophy of Mind , 2002 .

[12]  S. Iyengar,et al.  News That Matters: Television and American Opinion , 1987 .

[13]  J. Thompson The Media and Modernity: A Social Theory of the Media , 1995 .

[14]  J. Singer The inner world of daydreaming , 1975 .

[15]  U. Neisser Cognition and reality: principles and implications , 1976 .

[16]  Mayer D. Schwartz,et al.  The Dexter Hypertext Reference Model , 1994, CACM.

[17]  Richard S. Lazarus,et al.  Stress and Emotion: A New Synthesis , 1999 .

[18]  Bertram C. Bruce,et al.  Theoretical issues in reading comprehension : perspectives from cognitive psychology, linguistics, artificial intelligence, and education , 1980 .

[19]  Doug Riecken,et al.  Introduction: personalized views of personalization , 2000, CACM.

[20]  G. M. Kinget On being human: A systematic view , 1975 .

[21]  Stephen Davies,et al.  A Companion to Aesthetics , 1995 .

[22]  E. Klinger,et al.  Modes of Normal Conscious Flow , 1978 .

[23]  Walter J. Ong Literacy and Orality in Our Times. , 1980 .

[24]  Noël Carroll,et al.  A Philosophy of Mass Art , 1999 .

[25]  P. Merikle,et al.  Distinguishing conscious from unconscious perceptual processes. , 1986, Canadian journal of psychology.

[26]  G. Ritzer Explorations in Social Theory: From Metatheorizing to Rationalization , 2001 .

[27]  Gerald Millerson The technique of television production , 1961 .

[28]  T. K. Clarke,et al.  A New Perspective of Subliminal Perception , 1985 .

[29]  W. Ong The Presence of the Word: Some Prolegomena for Cultural and Religious History , 1970 .

[30]  G. Lakoff,et al.  Philosophy in the flesh : the embodied mind and its challenge to Western thought , 1999 .

[31]  Vladimir Propp,et al.  Morphology of the folktale , 1959 .

[32]  Shulamith Kreitler,et al.  Cognitive orientation and behavior , 1976 .

[33]  J. Bruner,et al.  Learning through experience and learning through media , 1973, Teachers College Record: The Voice of Scholarship in Education.

[34]  K. Koffka Principles Of Gestalt Psychology , 1936 .

[35]  C. Mattei,et al.  Julian Jaynes. The Origin of Consciousness in the Breakdown of the Bicameral Mind. Boston: Houghton Mifflin Co., 1978. , 1988 .

[36]  Barry H. Kantowitz,et al.  Experimental Psychology: Understanding Psychological Research , 1978 .

[37]  H. E. Krugman,et al.  Brain wave measures of media involvement. , 1971 .

[38]  Frank Biocca,et al.  Telepresence via Television: Two Dimensions of Telepresence May Have Different Connections to Memory and Persuasion , 2006, J. Comput. Mediat. Commun..

[39]  R. Barthes,et al.  Image-Music-Text , 1977 .

[40]  R. Gregory Eye and Brain: The Psychology of Seeing , 1966 .

[41]  J. Webster,et al.  Flow in Computer-Mediated Communication , 1992 .

[42]  Laura K. Guerrero,et al.  Communication and emotion: Basic concepts and approaches , 1996 .

[43]  Jo Brunas-Wagstaff Personality: A Cognitive Approach , 1998 .

[44]  R. Riding On the Nature of Cognitive Style , 1997 .

[45]  N. Frijda The laws of emotion. , 1988, The American psychologist.

[46]  R. Shepard Ecological constraints on internal representation: resonant kinematics of perceiving, imagining, thinking, and dreaming. , 1984, Psychological review.

[47]  Of that which we cannot write: Some notes on the phenomenology of media , 1988 .

[48]  L. N. Karlovic,et al.  Fostering Critical Reflection in Adulthood: A Guide to Transformative and Emancipatory Learning. Jack Mezirow. 1990. San Francisco: Jossey-Bass. , 1992, Canadian Journal for the Study of Adult Education.

[49]  E. Sosa,et al.  A Companion to Epistemology , 1992 .

[50]  B. Fischhoff,et al.  KNOWING WHAT YOU WANT: MEASURING LABILE VALUES , 1988 .

[51]  B. Baars A cognitive theory of consciousness , 1988 .

[52]  Noël Carroll,et al.  A Philosophy of Mass Art , 1999 .

[53]  G. Metalsky,et al.  2 – Attributional Styles: Toward a Framework for Conceptualization and Assessment1 , 1981 .

[54]  I. Kant,et al.  Critique of judgment , 2000 .

[55]  R. Sternberg In search of the human mind , 1994 .

[56]  D. Stern The interpersonal world of infant , 1985 .

[57]  Murray T. Maybery,et al.  Implicit and Explicit Mental Processes , 1998 .

[58]  Jean Mitry,et al.  The Aesthetics and Psychology of the Cinema , 1997 .

[59]  L. Richardson NARRATIVE AND SOCIOLOGY , 1990 .

[60]  K. Hurrelmann Social Structure and Personality Development: The Individual as a Productive Processor of Reality , 1988 .

[61]  G. Lakoff Women, fire, and dangerous things : what categories reveal about the mind , 1989 .

[62]  平林 紀子,et al.  (3) Denis McQuail, MASS COMMUNICATION THEORY: An Introduction, second Edition, Sage Publications, 1987 , 1988 .

[63]  A. Maslow Motivation and Personality , 1954 .

[64]  B. Höijer,et al.  Reception of television narration as a socio-cognitive process: A schema-theoretical outline , 1992 .

[65]  John P. Robinson,et al.  Measures Of Personality And Social Psychological Attitudes , 1991 .

[66]  R. Plutchik Emotion, a psychoevolutionary synthesis , 1980 .

[67]  Dennis L. Hoffman,et al.  Marketing in Hypermedia Computer-Mediated Environments : Conceptual Foundations 1 ) , 1998 .

[68]  R. Riding,et al.  Cognitive Styles and Learning Strategies , 2013 .

[69]  W. James Potter,et al.  Perceived reality and the cultivation hypothesis , 1986 .

[70]  S. Palmer Vision Science : Photons to Phenomenology , 1999 .

[71]  R. Shepard Ecological constraints on internal representation: resonant kinematics of perceiving, imagining, thinking, and dreaming. , 1984, Psychological review.

[72]  J. Chesebro Text, narration, and media , 1989 .

[73]  G. Lakoff,et al.  Women, Fire, and Dangerous Things: What Categories Reveal about the Mind , 1988 .

[74]  James W. Chesebro,et al.  Analyzing Media: Communication Technologies as Symbolic and Cognitive Systems , 1996 .

[75]  Larry L. Jacoby,et al.  Lectures for a layperson: Methods for revealing unconscious processes. , 1992 .

[76]  Felicia Pratto,et al.  Individual construct accessibility and perceptual selection , 1986 .

[77]  R. Lazarus,et al.  Passion and reason : making sense of our emotions , 1994 .

[78]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[79]  R. Zajonc Attitudinal effects of mere exposure. , 1968 .

[80]  Bernard J. Baars,et al.  Cognitive views of consciousness:What are the facts? How can we explain them? , 1996 .

[81]  C. MacLeod Implicit Perception: Perceptual Processing Without Awareness , 1998 .

[82]  G. Lakoff,et al.  Metaphors We Live by , 1981 .

[83]  Arthur Asa Berger,et al.  Narratives in Popular Culture, Media, and Everyday Life , 1996 .

[84]  S. Millar Reading by touch , 1997 .

[85]  I. Nonaka,et al.  The Knowledge Creating Company , 2008 .

[86]  B. Schneiderman,et al.  Designing the User Interface. Strategies for Effective Human-Computer Interaction , 1992 .

[87]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[88]  Carolyn R. Miller Technology as a form of consciousness: A study of contemporary ethos , 1978 .

[89]  James W. Keefe,et al.  Learning Style Theory and Practice , 1987 .

[90]  J. Mezirow Transformative Dimensions of Adult Learning , 1991 .

[91]  Annie Lang Involuntary Attention and Physiological Arousal Evoked by Structural Features and Emotional Content in TV Commercials , 1990 .

[92]  Erkki Karvonen,et al.  Imagologia. Imagon teorioiden esittelyä, analyysiä, kritiikkiä , 1997 .

[93]  D. McQuail Mass Communication Theory: An Introduction , 1983 .

[94]  R. Gregg Symbolic Inducement and Knowing: A Study in the Foundations of Rhetoric , 1984 .

[95]  Geoffrey Underwood,et al.  SEMANTIC INTERFERENCE FROM UNATTENDED PRINTED WORDS , 1976 .

[96]  Andrew Sayer,et al.  Method in Social Science: A Realist Approach , 1984 .

[97]  Werner J. Severin,et al.  Communication Theories: Origins, Methods and Uses in the Mass Media , 1991 .

[98]  C. Brewin Cognitive Foundations of Clinical Psychology , 1988 .

[99]  W. James,et al.  The Principles of Psychology. , 1983 .

[100]  M. Turpeinen Customizing News Content for Individuals and Communities , 2000 .

[101]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[102]  K. Popper,et al.  The self and its brain , 1979 .

[103]  M. Porat The Information Economy: Definition and Measurement. , 1977 .

[104]  Jean G. Harrell,et al.  The Work of Music and the Problem of Its Identity , 1986 .

[105]  Byron Reeves,et al.  Negative video as structure: Emotion, attention, capacity, and memory , 1996 .

[106]  Aristotle,et al.  The Poetics of Aristotle , 1988 .

[107]  H. Hunt On the Nature of Consciousness: Cognitive, Phenomenological, and Transpersonal Perspectives , 1995 .

[108]  Thomas Erickson Designing agents as if people mattered , 1997 .

[109]  Qingwen Dong,et al.  The Effects of Emotional Arousal and Valence on Television Viewers' Cognitive Capacity and Memory. , 1995 .

[110]  Craig A. Smith,et al.  Knowledge and Appraisal in the Cognition-Emotion Relationship , 1988 .

[111]  R. Logan The Alphabet Effect: The Impact of the Phonetic Alphabet on the Development of Western Civilization , 1989 .

[112]  E. V. Hornbostel,et al.  The unity of the senses. , 1938 .

[113]  L. Manovich,et al.  The language of new media , 2001 .

[114]  H. W. Fowler,et al.  The shorter Oxford English dictionary on historical principles , 2016 .

[115]  P. Lewicki,et al.  Nonconscious acquisition of information. , 1992, The American psychologist.

[116]  Matthew Lombard,et al.  MEASURING PRESENCE: A LITERATURE-BASED APPROACH TO THE DEVELOPMENT OF A STANDARDIZED PAPER-AND-PENCIL INSTRUMENT , 2000 .

[117]  J. Bruner Actual minds, possible worlds , 1985 .

[118]  Walter J. Ong Interfaces of the Word: Studies in the Evolution of Consciousness and Culture , 1980 .

[119]  Leo Bogart,et al.  The Age of Television , 1959 .

[120]  Ralph L. Rosnow,et al.  The Emergence of Contextualism , 1985 .

[121]  D. O. Hebb,et al.  What psychology is about. , 1974 .

[122]  J. Krosnick,et al.  Subliminal Conditioning of Attitudes , 1992 .

[123]  M. Lombard,et al.  Presence and Television: The Role of Screen Size. , 2000 .

[124]  G. Farthing,et al.  The psychology of consciousness , 1991 .

[125]  Herbert A. Simon,et al.  Situated Action: A Symbolic Interpretation , 1993, Cogn. Sci..

[126]  R. Wilkinson A Companion to aesthetics , 1994 .

[127]  J. Bargh Does subliminality matter to social psychology? Awareness of the stimulus versus awareness of its influence. , 1992 .

[128]  Toni Campbell,et al.  Communicating More than Content: Formal Features of Children's Television Programs , 1981 .

[129]  H. Tsoukas The Validity of Idiographic Research Explanations , 1989 .

[130]  Paula M. Niedenthal,et al.  Implicit perception of affective information , 1990 .

[131]  Hugh L. Wagner The Psychobiology of Human Motivation , 1999 .

[132]  Laird Addis Of Mind And Music , 1999 .

[133]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[134]  M. Esslin The age of television , 1981 .

[135]  M. Mcluhan Understanding Media: The Extensions of Man , 1964 .

[136]  Anselm L. Strauss,et al.  Basics of qualitative research : techniques and procedures for developing grounded theory , 1998 .

[137]  A. Isen,et al.  Toward understanding the role of affect in cognition. , 1984 .

[138]  Norbert Schwarz,et al.  Feelings and their motivational implications: Moods and the action sequence , 1996 .

[139]  H. W. Winger : The Gutenberg Galaxy: The Making of Typographic Man , 1963 .

[140]  J. Bargh,et al.  Automatic information processing and social perception: The influence of trait information presented outside of conscious awareness on impression formation. , 1982 .

[141]  W. Ong,et al.  Orality and literacy : the technologizing of the word , 1982 .

[142]  J. Valsiner,et al.  Naturalistic research and ecological thinking in the study of child development , 1986 .

[143]  Everett M. Rogers,et al.  Communication Technology: The New Media in Society , 1986 .

[144]  L. Ross,et al.  Human Inference: Strategies and Shortcomings of Social Judgment. , 1981 .

[145]  Tim O'Sullivan,et al.  Key Concepts in Communication and Cultural Studies , 1993 .

[146]  J. Bargh,et al.  Automaticity in action: The unconscious as repository of chronic goals and motives. , 1996 .

[147]  Donald N. McCloskey Storytelling in Economics , 2001 .

[148]  F. Crick The Astonishing Hypothesis , 1994 .

[149]  Dominic W. Massaro,et al.  Observer Mechanics: A Formal Theory of Perception , 1989 .

[150]  A. Giddens NEW RULES OF SOCIOLOGICAL METHOD , 1980 .

[151]  W. Iser The Reading Process: A Phenomenological Approach , 1972 .

[152]  Lesley Brown,et al.  The new shorter Oxford English dictionary on historical principles , 1993 .

[153]  E. Reed The Ecological Approach to Visual Perception , 1989 .

[154]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .

[155]  N. Henley,et al.  Body Politics: Power, Sex, and Nonverbal Communication , 1977 .

[156]  N. Goodman Languages of Art , 1968 .

[157]  E. Hall,et al.  The Hidden Dimension , 1970 .

[158]  M. Knapp,et al.  Nonverbal communication in human interaction , 1972 .

[159]  A. Marcel Conscious and unconscious perception: An approach to the relations between phenomenal experience and perceptual processes , 1983, Cognitive Psychology.

[160]  G. Ray Funkhouser,et al.  How Synthetic Experience Shapes Social Reality , 1990 .

[161]  S. Folkman,et al.  Stress, appraisal, and coping , 1974 .

[162]  H L Roediger,et al.  Implicit memory. Retention without remembering. , 1990, The American psychologist.

[163]  Cynthia A. Erdley,et al.  Cognitive and affective components of automatic priming effects. , 1988 .

[164]  Bernard Berelson,et al.  Human behavior: An inventory of scientific findings. , 1967 .

[165]  G. Lakoff,et al.  Metaphors We Live By , 1980 .

[166]  F. Biocca,et al.  Communication in the age of virtual reality , 1995 .

[167]  M. Rokeach The Nature Of Human Values , 1974 .

[168]  C. Izard The Emergence of Emotions and the Development of Consciousness in Infancy , 1980 .

[169]  J. Wilding,et al.  Semantic interference from subliminal stimuli in a dichoptic viewing situation. , 1979, British journal of psychology.

[170]  W. Bechtel,et al.  A companion to cognitive science , 1999 .

[171]  D. Wegner,et al.  The feeling of doing. , 1996 .

[172]  P. Young,et al.  Emotion and personality , 1963 .

[173]  N. Frijda Moods, emotion episodes, and emotions. , 1993 .

[174]  K. Popper,et al.  The self and its brain , 1977 .

[175]  Clifford Nass,et al.  Anthropocentrism and computers , 1995, Behav. Inf. Technol..

[176]  Eric A. Havelock,et al.  The Muse Learns to Write: Reflections on Orality and Literacy from Antiquity to the Present , 1988 .

[177]  V. Sobchack The Address of the Eye: A Phenomenology of Film Experience , 1991 .

[178]  S. Langer Philosophy in a new key : a study in the symbolism of reason, rite, and art , 1944 .

[179]  R. May Psychology and the human dilemma , 1979 .

[180]  Richard D. Zakia Perception and imaging , 1997 .