Processing from Fingertips in Touchscreen Phone Users

Institute of Cognitive Neuroscience, University CollegeLondon, 17 Queen Square, London WC1N 3AR, UKSummaryCortical activity allotted to the tactile receptors on fingertipsconforms to skilful use of the hand [1–3]. For instance, instring instrument players, the somatosensory cortical activ-ity in response to touch on the little fingertip is larger thanthat in control subjects [1]. Such plasticity of the fingertipsensory representation is not limited to extraordinary skillsand occurs in monkeys trained to repetitively grasp andrelease a handle as well [4]. Touchscreen phones alsorequire repetitive finger movements, but whether and howthe cortex conforms to this is unknown. By using electroen-cephalography(EEG),wemeasuredthecorticalpotentialsinresponsetomechanicaltouchonthethumb,index,andmid-dle fingertips of touchscreen phone users and nonusers(owning only old-technology mobile phones). Although thethumb interacted predominantly with the screen, the poten-tials associated with the three fingertips were enhanced intouchscreen users compared to nonusers. Within thetouchscreen users, the cortical potentials from the thumband index fingertips were directly proportional to the inten-sity of use quantified with built-in battery logs. Remarkably,the thumb tip was sensitive to the day-to-day fluctuations inphone use: the shorter the time elapsed from an episode ofintense phone use, the larger the cortical potential associ-ated with it. Our results suggest that repetitive movementson the smooth touchscreen reshaped sensory processingfrom the hand and that the thumb representation was up-dated daily depending on its use. We propose that corticalsensory processing in the contemporary brain is continu-ously shaped by the use of personal digital technology.ResultsCortical Fingertip Representations in Touchscreen PhoneUsers Differ from Those Found in NonusersWe analyzed 37 right-handed volunteers, 26 of whom usedtouchscreen phones and 11 of whom used old-technologymobile phones. Questionnaires provided few key insightsinto how the more modern phones were used. First,touchscreen users primarily used their right thumb on thescreen as opposed to other fingers (Figure 1A), and none ofthemusedastylus.Thethumbpreferencewasexpectedgiventhat hand-held phones were designed as such [5]. Second, inagreement with a US national survey on smartphone use,80% of the touchscreen users in our study mainly used theirphone for receiving and sending text messages or e-mails,as opposed to passively listening to music, watching videos,or making calls [6]. Finally, according to the self-reports,touchscreen users spent noticeably more time with theirphones than did the nonusers (Figure 1B).Weinvestigatedwhetherthesomatosensorycorticalelectri-cal activity evoked from the fingertips differed betweentouchscreen phone users and nonusers. Sixty-two surfaceelectrodes distributed over the entire scalp were used todetect cortical potentials evoked by touch on the thumb, in-dex, and middle fingertips of the right hand. Each tactile stim-ulus consisted of a light mechanical contact that lasted for2 ms, and event-related potentials (ERPs) were based on1,250 stimulations on each fingertip. For all three fingertipstested both in touchscreen users and nonusers, the touch re-sulted in a dipole field around the contralateral (to stimulation)somatosensory cortex with signal onset at 32 ms and peak at55 ms (on grand mean traces). The positive ERPs were de-tectedinthecontralateralparietalelectrodes,andthenegativesignalsweredetectedmoremediallyinthecontra-andipsilat-eral frontal electrodes (Figures 1C–1H). Based on the latencyand signal topology, we could assert that these signals origi-nated from the primary somatosensory cortex [7–9]. Weanalyzed the signal differences between the touchscreenusers and nonusers across all time points (50 ms prestimula-tionto120mspoststimulation)andforeachelectrodebyusingtwo-sample t tests corrected for multiple comparisons using2D spatiotemporal clustering [10]. Interestingly, for all of thetested fingertips, the amplitude of the positive ERP was largerin touchscreen users compared to nonusers (Figures 1C–1H).Temporally,thepositivesignalsdifferedbetween39and68msforthethumbtip, between 38and60msfor theindex fingertip,andbetween48and66msforthemiddlefingertip(Figures1C,1E, and 1G). Spatially, the statistical maps revealed that thedifferences were clustered on the contralateral parietal scalpfor all the three fingertips (Figures 1D, 1F, and 1H). However,the spatial extent of these differences was the smallest forthe middle finger (Figure 1H).In short, touchscreen users relied mostly on their thumb tointeract with the screen, but the cortical potentials associatedwith the first three fingertips were enhanced in comparison tononusers. However, the spatiotemporal impact of phone usewas the least prominent for the middle fingertip.The Amount of Touchscreen Phone Use InfluencesCortical ActivityTheincreasedcorticalactivityintouchscreen userscomparedtononuserscouldbeduetoamoreintenseusageofthehand,in the sense that the former group used the right thumb morethan the latter group did. Alternatively, it could be due tothe development of touchscreen-specific motor routines or‘‘skills’’ as the movements associated with push buttons (innonusers, who used only old-technology mobile phones)

[1]  S. Feldman,et al.  Frictional lichenified dermatosis from prolonged use of a computer mouse: Case report and review of the literature of computer-related dermatoses. , 2010, Dermatology online journal.

[2]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[3]  R Llinás,et al.  Anatomical localization revealed by MEG recordings of the human somatosensory system. , 1991, Electroencephalography and clinical neurophysiology.

[4]  J. Kaas,et al.  Plasticity of Somatosensory Cortex in Primates , 1997 .

[5]  Gernot Heiser,et al.  An Analysis of Power Consumption in a Smartphone , 2010, USENIX Annual Technical Conference.

[6]  B. Rockstroh,et al.  Increased Cortical Representation of the Fingers of the Left Hand in String Players , 1995, Science.

[7]  Olaf Dössel,et al.  Source analysis of median nerve and finger stimulated somatosensory evoked potentials: Multichannel simultaneous recording of electric and magnetic fields combined with 3d-MR tomography , 2005, Brain Topography.

[8]  Jürgen Konczak,et al.  Interaction of finger representation in the human first somatosensory cortex: a neuromagnetic study , 1998, Neuroscience Letters.

[9]  Juan Pablo Hourcade,et al.  Evaluating one handed thumb tapping on mobile touchscreen devices , 2008, Graphics Interface.

[10]  Giacomo Koch,et al.  A common polymorphism in the brain‐derived neurotrophic factor gene (BDNF) modulates human cortical plasticity and the response to rTMS , 2008, The Journal of physiology.

[11]  Guillaume A. Rousselet,et al.  LIMO EEG: A Toolbox for Hierarchical LInear MOdeling of ElectroEncephaloGraphic Data , 2011, Comput. Intell. Neurosci..

[12]  Stephen J. Jones,et al.  Potentials evoked in human and monkey cerebral cortex by stimulation of the median nerve. A review of scalp and intracranial recordings. , 1991, Brain : a journal of neurology.

[13]  Shwetak N. Patel,et al.  GripSense: using built-in sensors to detect hand posture and pressure on commodity mobile phones , 2012, UIST.

[14]  M. Hallett,et al.  Rapid plasticity of human cortical movement representation induced by practice. , 1998, Journal of neurophysiology.

[15]  C. C. Wood,et al.  The relationship between human long-latency somatosensory evoked potentials recorded from the cortical surface and from the scalp. , 1992, Electroencephalography and clinical neurophysiology.

[16]  Heidi M. Schambra,et al.  Direct Current Stimulation Promotes BDNF-Dependent Synaptic Plasticity: Potential Implications for Motor Learning , 2010, Neuron.

[17]  B. Amick,et al.  Musculoskeletal symptoms among mobile hand-held device users and their relationship to device use: A preliminary study in a Canadian university population. , 2011, Applied ergonomics.

[18]  Á. Pascual-Leone,et al.  Plasticity of the sensorimotor cortex representation of the reading finger in Braille readers. , 1993, Brain : a journal of neurology.

[19]  T. Hackett,et al.  Thalamic and cortical contributions to neural plasticity after limb amputation. , 2000, Journal of neurophysiology.

[20]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[21]  S S Nagarajan,et al.  Differences in somatosensory hand organization in a healthy flutist and a flutist with focal hand dystonia: a case report. , 2000, Journal of hand therapy : official journal of the American Society of Hand Therapists.

[22]  G. Recanzone,et al.  Changes in the distributed temporal response properties of SI cortical neurons reflect improvements in performance on a temporally based tactile discrimination task. , 1992, Journal of neurophysiology.

[23]  R. Johansson,et al.  Responses in glabrous skin mechanoreceptors during precision grip in humans , 2004, Experimental Brain Research.

[24]  Arthur C. Grant,et al.  Tactile perception in blind Braille readers: A psychophysical study of acuity and hyperacuity using gratings and dot patterns , 2000, Perception & psychophysics.

[25]  Sadatoshi Tsuji,et al.  Effect of transcranial DC sensorimotor cortex stimulation on somatosensory evoked potentials in humans , 2004, Clinical Neurophysiology.

[26]  Ahmad Rahmati,et al.  Studying Smartphone Usage: Lessons from a Four-Month Field Study , 2013, IEEE Transactions on Mobile Computing.

[27]  S. C. Gandevia,et al.  Convergence in the somatosensory pathway between cutaneous afferents from the index and middle fingers in man , 2004, Experimental Brain Research.

[28]  Y. Okada,et al.  Contributions of principal neocortical neurons to magnetoencephalography and electroencephalography signals , 2006, The Journal of physiology.

[29]  J. Rothwell,et al.  Task-specific hand dystonia: can too much plasticity be bad for you? , 2006, Trends in Neurosciences.

[30]  Peng Dai,et al.  A Smartphone User Activity Prediction Framework Utilizing Partial Repetitive and Landmark Behaviors , 2014, 2014 IEEE 15th International Conference on Mobile Data Management.

[31]  W. Schady,et al.  Peripheral nerve dysfunction in scleroderma. , 1991, The Quarterly journal of medicine.

[32]  C. Koch,et al.  The origin of extracellular fields and currents — EEG, ECoG, LFP and spikes , 2012, Nature Reviews Neuroscience.

[33]  M. Hallett,et al.  Disordered plasticity in the primary somatosensory cortex in focal hand dystonia. , 2009, Brain : a journal of neurology.

[34]  W M Jenkins,et al.  A primate genesis model of focal dystonia and repetitive strain injury , 1996, Neurology.

[35]  Ingrid M. Kanics,et al.  Tactile Acuity is Enhanced in Blindness , 2003, The Journal of Neuroscience.

[36]  T. Elbert,et al.  Representational Cortex in Musicians , 2001, Annals of the New York Academy of Sciences.

[37]  A. Nakamura,et al.  Somatosensory Homunculus as Drawn by MEG , 1998, NeuroImage.

[38]  Niels Birbaumer,et al.  Extensive reorganization of primary somatosensory cortex in chronic back pain patients , 1997, Neuroscience Letters.

[39]  M. Nitsche,et al.  Pharmacological Modulation of Cortical Excitability Shifts Induced by Transcranial Direct Current Stimulation in Humans , 2003, The Journal of physiology.

[40]  Niranjan Kambi,et al.  Large-scale reorganization of the somatosensory cortex following spinal cord injuries is due to brainstem plasticity , 2014, Nature Communications.

[41]  M. Hulliger,et al.  The responses of afferent fibres from the glabrous skin of the hand during voluntary finger movements in man. , 1979, The Journal of physiology.

[42]  Kenji Sakuma,et al.  Somatosensory evoked potentials and high-frequency oscillations in athletes , 2008, Clinical Neurophysiology.