The details of past actions on a smartphone touchscreen are reflected by intrinsic sensorimotor dynamics

Unconstrained day-to-day activities are difficult to quantify and how the corresponding movements shape the brain remain unclear. Here, we recorded all touchscreen smartphone interactions at a sub-second precision and show that the unconstrained day-to-day behavior captured on the phone reflects in the simple sensorimotor computations measured in the laboratory. The behavioral diversity on the phone, the speed of interactions, the amount of social & non-social interactions, all uniquely influenced the trial-to-trial motor variability used to measure the amount of intrinsic neuronal noise. Surprisingly, both the motor performance and the early somatosensory cortical signals (assessed using EEG in passive conditions) became noisier with increased social interactions. Inter-individual differences in how people use the smartphone can help thus decompose the structure of low-level sensorimotor computations.

[1]  J. Carlson,et al.  Reaction Time, Movement Time, and Intelligence: A Replication and Extension. , 1982 .

[2]  D. Gentner.  The acquisition of typewriting skill , 1983 .

[3]  R. C. Oldfield.  The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[4]  C. C. Wood,et al.  The relationship between human long-latency somatosensory evoked potentials recorded from the cortical surface and from the scalp. , 1992, Electroencephalography and clinical neurophysiology.

[5]  K. Campbell,et al.  Reaction time and movement time as measures of stimulus evaluation and response processes , 1994 .

[6]  G. Davis,et al.  Current Opinion in Neurobiology 2011 , 2011 .

[7]  E. Altenmüller,et al.  The musician's brain as a model of neuroplasticity , 2002, Nature Reviews Neuroscience.

[8]  A. Kelley,et al.  Early consolidation of instrumental learning requires protein synthesis in the nucleus accumbens , 2002, Nature Neuroscience.

[9]  K. Newell,et al.  Noise, variability, and the development of children’s perceptual-motor skills , 2005 .

[10]  David J. Heeger,et al.  Unreliable Evoked Responses in Autism , 2012, Neuron.

[11]  J. Krakauer,et al.  Human sensorimotor learning: adaptation, skill, and beyond , 2011, Current Opinion in Neurobiology.

[12]  Eric M. Rouiller,et al.  Use-Dependent Cortical Processing from Fingertips in Touchscreen Phone Users , 2015, Current Biology.

[13]  Dorothy V. M. Bishop,et al.  Journal of Neuroscience Methods , 2015 .

[14]  B. Rockstroh,et al.  Increased Cortical Representation of the Fingers of the Left Hand in String Players , 1995, Science.

[15]  Christian Montag,et al.  Toward Psychoinformatics: Computer Science Meets Psychology , 2016, Comput. Math. Methods Medicine.

[16]  M. Kilgard,et al.  Cortical plasticity and rehabilitation. , 2006, Progress in brain research.

[17]  Denis Cousineau,et al.  How to use MATLAB to fit the ex-Gaussian and other probability functions to a distribution of response times , 2008 .

[18]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[19]  S. Makeig,et al.  Mining event-related brain dynamics , 2004, Trends in Cognitive Sciences.

[20]  D. Sternad,et al.  Variability in motor learning: relocating, channeling and reducing noise , 2009, Experimental Brain Research.

[21]  Guillaume A. Rousselet,et al.  LIMO EEG: A Toolbox for Hierarchical LInear MOdeling of ElectroEncephaloGraphic Data , 2011, Comput. Intell. Neurosci..

[22]  Masayoshi Kubo,et al.  Neuromagnetic activation of primary and secondary somatosensory cortex following tactile-on and tactile-off stimulation , 2010, Clinical Neurophysiology.

[23]  H. Heekeren,et al.  Nucleus accumbens response to gains in reputation for the self relative to gains for others predicts social media use , 2013, Front. Hum. Neurosci..