Doing Psychological Science by Hand

Over the past decade, mouse tracking in choice tasks has become a popular method across psychological science. This method exploits hand movements as a measure of multiple response activations that can be tracked continuously over hundreds of milliseconds. Whereas early mouse-tracking research focused on specific debates, researchers have realized that the methodology has far broader theoretical value. This more recent work demonstrates that mouse tracking is a widely applicable measure across the field, capable of exposing the microstructure of real-time decisions, including their component processes and millisecond-resolution time course, in ways that inform theory. In this article, recent advances in the mouse-tracking approach are described, and comparisons with the gold standard measure of reaction time and other temporally sensitive methodologies are provided. Future directions, including mapping to neural representations with brain imaging and ways to improve our theoretical understanding of mouse-tracking methodology, are discussed.

[1]  K. Nakayama,et al.  Target selection in visual search as revealed by movement trajectories , 2008, Vision Research.

[2]  Lewis Bott,et al.  Intonation and Pragmatic Enrichment: How Intonation Constrains Ad Hoc Scalar Inferences , 2017, Language and speech.

[3]  Jonathan B Freeman,et al.  A Perceptual Pathway to Bias , 2016, Psychological science.

[4]  Roger P. G. van Gompel,et al.  Reanalysis in Sentence Processing: Evidence against Current Constraint-Based and Two-Stage Models , 2001 .

[5]  James S Magnuson,et al.  Moving hand reveals dynamics of thought. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[6]  R. Nisbett,et al.  Culture and systems of thought: holistic versus analytic cognition. , 2001, Psychological review.

[7]  Martial Mermillod,et al.  Differential effects of visual uncertainty and contextual guidance on perceptual decisions: Evidence from eye and mouse tracking in visual search. , 2016, Journal of vision.

[8]  Jonathan B Freeman,et al.  Differential effects of cognitive load on subjective versus motor responses to ambiguously valenced facial expressions. , 2016, Emotion.

[9]  Carla J. Groom,et al.  Separating multiple processes in implicit social cognition: the quad model of implicit task performance. , 2005, Journal of personality and social psychology.

[10]  Shihui Han,et al.  Influences of Culture and Visual Context on Real-Time Social Categorization. , 2013, Journal of experimental social psychology.

[11]  T. Goschke,et al.  How decisions emerge: action dynamics in intertemporal decision making. , 2013, Journal of experimental psychology. General.

[12]  Rick Dale,et al.  The Cognitive Dynamics of Negated Sentence Verification , 2011, Cogn. Sci..

[13]  Michael J. Spivey,et al.  Action Dynamics Reveal Parallel Competition in Decision Making , 2008, Psychological science.

[14]  N. Sebanz,et al.  Do people automatically track others’ beliefs? Evidence from a continuous measure , 2014, Cognition.

[15]  N. Schwarz,et al.  Mixed feelings: the case of ambivalence , 2017, Current Opinion in Behavioral Sciences.

[16]  Nicholas C. Hindy,et al.  Computer-mouse tracking reveals TMS disruptions of prefrontal function during semantic retrieval. , 2009, Journal of neurophysiology.

[17]  J. Kalaska,et al.  Neural Correlates of Reaching Decisions in Dorsal Premotor Cortex: Specification of Multiple Direction Choices and Final Selection of Action , 2005, Neuron.

[18]  Cendri A. C. Hutcherson,et al.  Dietary Self-Control Is Related to the Speed With Which Attributes of Healthfulness and Tastiness Are Processed , 2015, Psychological science.

[19]  Nathan F. Lepora,et al.  Embodied Choice: How Action Influences Perceptual Decision Making , 2015, PLoS Comput. Biol..

[20]  K. Nakayama,et al.  Hidden cognitive states revealed in choice reaching tasks , 2009, Trends in Cognitive Sciences.

[21]  K. Nakayama,et al.  Role of focal attention on latencies and trajectories of visually guided manual pointing. , 2006, Journal of vision.

[22]  Nicholas D. Duran,et al.  The action dynamics of overcoming the truth , 2010, Psychonomic bulletin & review.

[23]  James M. Jones,et al.  Bulletin Personality and Social Psychology Adaptive Disengagement Buffers Self-esteem from Negative Social Feedback on Behalf Of: Society for Personality and Social Psychology , 2022 .

[24]  Gregory J. Koop An assessment of the temporal dynamics of moral decisions , 2013, Judgment and Decision Making.

[25]  Michael J. Spivey,et al.  Continuous Dynamics in Real-Time Cognition , 2006 .

[26]  Zachary A. Ingbretsen,et al.  Positivity bias in judging ingroup members' emotional expressions. , 2016, Emotion.

[27]  Jennifer M. Roche,et al.  Exploring Action Dynamics as an Index of Paired-Associate Learning , 2008, PloS one.

[28]  Phillip J. Holcomb,et al.  The real-time link between person perception and action: Brain potential evidence for dynamic continuity , 2011, Social neuroscience.

[29]  J. Freeman,et al.  Advanced mouse-tracking analytic techniques for enhancing psychological science , 2015 .

[30]  J. Freeman,et al.  A Neural Mechanism of Social Categorization , 2017, The Journal of Neuroscience.

[31]  Jonathan B Freeman,et al.  Abrupt category shifts during real-time person perception , 2014, Psychonomic bulletin & review.

[32]  Giovanni Pezzulo,et al.  Tracking Second Thoughts: Continuous and Discrete Revision Processes during Visual Lexical Decision , 2015, PloS one.

[33]  Felix Henninger,et al.  Mousetrap: An integrated, open-source mouse-tracking package , 2017, Behavior Research Methods.

[34]  N. Ambady,et al.  Motions of the Hand Expose the Partial and Parallel Activation of Stereotypes , 2009, Psychological science.

[35]  Michael J. Spivey,et al.  Graded motor responses in the time course of categorizing atypical exemplars , 2007, Memory & cognition.

[36]  Rick Dale,et al.  The Self-Organization of Explicit Attitudes , 2009, Psychological science.

[37]  Michael J. Spivey,et al.  Tracking the Continuity of Language Comprehension: Computer Mouse Trajectories Suggest Parallel Syntactic Processing , 2007, Cogn. Sci..

[38]  Kerri L. Johnson,et al.  Will a category cue attract you? Motor output reveals dynamic competition across person construal. , 2008, Journal of experimental psychology. General.

[39]  Rick Dale,et al.  Assessing bimodality to detect the presence of a dual cognitive process , 2013, Behavior research methods.

[40]  Michael J. Spivey,et al.  Continuous attraction toward phonological competitors. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[41]  J. Kalaska,et al.  Neural mechanisms for interacting with a world full of action choices. , 2010, Annual review of neuroscience.

[42]  Denis O'Hora,et al.  Decisions in Motion: Decision Dynamics during Intertemporal Choice reflect Subjective Evaluation of Delayed Rewards , 2016, Scientific Reports.

[43]  Michael J. Spivey,et al.  THE PHASE TRANSITION IN HUMAN COGNITION , 2009 .

[44]  Takashi Yamauchi,et al.  The role of attention in subliminal semantic processing: A mouse tracking study , 2017, PloS one.

[45]  M. Goodale,et al.  The visual brain in action , 1995 .

[46]  P. Devine Stereotypes and prejudice: Their automatic and controlled components. , 1989 .

[47]  Michael S Landy,et al.  Motor control is decision-making , 2012, Current Opinion in Neurobiology.

[48]  Jonathan B Freeman,et al.  Neural pattern similarity reveals the inherent intersection of social categories , 2016, Nature Neuroscience.

[49]  Eric Hehman,et al.  The neural basis of stereotypic impact on multiple social categorization , 2014, NeuroImage.

[50]  David A Rosenbaum,et al.  The Cinderella of psychology: the neglect of motor control in the science of mental life and behavior. , 2005, The American psychologist.

[51]  F. Donders On the speed of mental processes. , 1969, Acta psychologica.

[52]  Thomas A. Farmer,et al.  Hand in Motion Reveals Mind in Motion , 2011, Front. Psychology.

[53]  Simone Sulpizio,et al.  Analyzing spatial data from mouse tracker methodology: An entropic approach , 2017, Behavior research methods.

[54]  Paul E. Stillman,et al.  Resisting Temptation: Tracking How Self-Control Conflicts Are Successfully Resolved in Real Time , 2017, Psychological science.

[55]  Nalini Ambady,et al.  Hand Movements Reveal the Time-course of Shape and Pigmentation Processing in Face Categorization , 2022 .

[56]  N. Ambady,et al.  A dynamic interactive theory of person construal. , 2011, Psychological review.

[57]  Martin H. Fischer,et al.  Pushing forward in embodied cognition: may we mouse the mathematical mind? , 2014, Front. Psychol..

[58]  Megan H. Papesh,et al.  Memory in motion: Movement dynamics reveal memory strength , 2012, Psychonomic Bulletin & Review.

[59]  Etienne P LeBel,et al.  What Do Implicit Measures Tell Us?: Scrutinizing the Validity of Three Common Assumptions , 2007, Perspectives on psychological science : a journal of the Association for Psychological Science.

[60]  John M. Tomlinson,et al.  Possibly All of that and Then Some: Scalar Implicatures Are Understood in Two Steps. , 2013 .

[61]  M. Spivey,et al.  Do curved reaching movements emerge from competing perceptions? A reply to van der Wel et al. (2009). , 2010, Journal of experimental psychology. Human perception and performance.

[62]  N. Ambady,et al.  Investigating the Early Stages of Person Perception: The Asymmetry of Social Categorization by Sex vs. Age , 2014, PloS one.

[63]  Jonathan B Freeman,et al.  MouseTracker: Software for studying real-time mental processing using a computer mouse-tracking method , 2010, Behavior research methods.

[64]  Nalini Ambady,et al.  Continuous dynamics in the real-time perception of race , 2010 .