Neural Activations Associated With Friction Stimulation on Touch-Screen Devices

Tactile sensation largely influences human perception, for instance when using a mobile device or a touch screen. Active touch, which involves tactile and proprioceptive sensing under the control of movement, is the dominant tactile exploration mechanism compared to passive touch (being touched). This paper investigates the role of friction stimulation objectively and quantitatively in active touch tasks, in a real human-computer interaction on a touch-screen device. In this study, 24 participants completed an active touch task involved stroking the virtual strings of a guitar on a touch-screen device while recording the electroencephalography (EEG) signal. Statistically significant differences in beta and gamma oscillations in the middle frontal and parietal areas at the late period of the active touch task are found. Furthermore, stronger beta event-related desynchronization (ERD) and rebound in the presence of friction stimulation in the contralateral parietal area are observed. However, in the ipsilateral parietal area, there is a difference in beta oscillation only at the late period of the motor task. As for implicit emotion communication, a significant increase in emotional responses for valence, arousal, dominance, and satisfaction is observed when the friction stimulation is applied. It is argued that the friction stimulation felt by the participants' fingertip in a touch-screen device further induces cognitive processing compared to the case when no friction stimulation is applied. This study provides objective and quantitative evidence that friction stimulation is able to affect the bottom-up sensation and cognitive processing.

[1]  Junsuk Kim,et al.  Human Brain Activity Related to the Tactile Perception of Stickiness , 2017, Front. Hum. Neurosci..

[2]  Nikos K. Logothetis,et al.  Desynchronization and rebound of beta oscillations during conscious and unconscious local neuronal processing in the macaque lateral prefrontal cortex , 2013, Front. Psychol..

[3]  Tzyy-Ping Jung,et al.  Real-time modeling and 3D visualization of source dynamics and connectivity using wearable EEG , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[4]  B Dan,et al.  Sensory and motor interfering influences on somatosensory evoked potentials. , 2000, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[5]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[6]  Jiaqing Lin,et al.  A Touch Screen Interface Design with Tactile Feedback , 2011, 2011 International Conference on Complex, Intelligent, and Software Intensive Systems.

[7]  Gert Pfurtscheller,et al.  EEG event-related desynchronization (ERD) and synchronization (ERS) , 1997 .

[8]  Stephen A. Brewster,et al.  Investigating the effectiveness of tactile feedback for mobile touchscreens , 2008, CHI.

[9]  Gil Yosipovitch,et al.  Somatosensory pleasure circuit: from skin to brain and back , 2015, Experimental dermatology.

[10]  J. Edward Colgate,et al.  Fingertip friction modulation due to electrostatic attraction , 2013, 2013 World Haptics Conference (WHC).

[11]  M. Hallett,et al.  Involvement of the ipsilateral motor cortex in finger movements of different complexities , 1997, Annals of neurology.

[12]  J. Peck,et al.  It Just Feels Good: Customers’ Affective Response to Touch and Its Influence on Persuasion: , 2006 .

[13]  A. Engel,et al.  Cognitive functions of gamma-band activity: memory match and utilization , 2004, Trends in Cognitive Sciences.

[14]  Francis McGlone,et al.  Cognitive influences on the affective representation of touch and the sight of touch in the human brain. , 2008, Social cognitive and affective neuroscience.

[15]  E. Basar,et al.  Brain oscillations in perception and memory. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[16]  S. Lederman.  The perception of surface roughness by active and passive touch , 1981 .

[17]  Nadia Bianchi-Berthouze,et al.  The brain’s response to pleasant touch: an EEG investigation of tactile caressing , 2014, Front. Hum. Neurosci..

[18]  Erol Başar,et al.  A review of gamma oscillations in healthy subjects and in cognitive impairment. , 2013, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[19]  Cagatay Basdogan,et al.  Effect of Waveform on Tactile Perception by Electrovibration Displayed on Touch Screens , 2017, IEEE Transactions on Haptics.

[20]  T. Egner,et al.  EEG Biofeedback of low beta band components: frequency-specific effects on variables of attention and event-related brain potentials , 2004, Clinical Neurophysiology.

[21]  David E Vaillancourt,et al.  Beta-band activity and connectivity in sensorimotor and parietal cortex are important for accurate motor performance , 2017, NeuroImage.

[22]  Shunsuke Ono,et al.  A multi-modal interactive tablet with tactile feedback, rear and lateral operation for maximum front screen visibility , 2016, 2016 IEEE Virtual Reality (VR).

[23]  Michiel M. A. Spapé,et al.  Feeling Touched: Emotional Modulation of Somatosensory Potentials to Interpersonal Touch , 2017, Scientific Reports.

[24]  Ingo Fründ,et al.  Human gamma-band activity: A review on cognitive and behavioral correlates and network models , 2010, Neuroscience & Biobehavioral Reviews.

[25]  Ole Jensen,et al.  Frontal Eye Fields Control Attentional Modulation of Alpha and Gamma Oscillations in Contralateral Occipitoparietal Cortex , 2015, The Journal of Neuroscience.

[26]  J. Edward Colgate,et al.  Dynamics of ultrasonic and electrostatic friction modulation for rendering texture on haptic surfaces , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[27]  W. Ray,et al.  EEG alpha activity reflects attentional demands, and beta activity reflects emotional and cognitive processes. , 1985, Science.

[28]  Ahmad Hisham Zainal Abidin,et al.  Touch screen with audio feedback: Content analysis and the effect of spatial ability on blind people's sense of position of web pages , 2013, 2013 International Conference on Research and Innovation in Information Systems (ICRIIS).

[29]  Silvestro Micera,et al.  Spatiotemporal Dynamics of the Cortical Responses Induced by a Prolonged Tactile Stimulation of the Human Fingertips , 2017, Brain Topography.

[30]  Jérémy Frey,et al.  Framework for Electroencephalography-based Evaluation of User Experience , 2016, CHI.

[31]  Cecile Lombart,et al.  A novel method using EEG to characterize the cortical processes involved in active and passive touch , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[32]  C. D. Binnie,et al.  EEG, paediatric neurophysiology, special techniques and applications , 2003 .

[33]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[34]  Koji Yatani,et al.  An evaluation of stylus-based text entry methods on handheld devices studied in different user mobility states , 2009, Pervasive Mob. Comput..

[35]  Daniel M. Wolpert,et al.  The Cerebellum Contributes to Somatosensory Cortical Activity during Self-Produced Tactile Stimulation , 1999, NeuroImage.

[36]  Koji Yatani,et al.  An evaluation of stylus-based text entry methods on handheld devices in stationary and mobile settings , 2007, Mobile HCI.

[37]  Wanjoo Park,et al.  Differences in Beta Oscillation of the Middle Frontal Cortex with or Without Tactile Stimulation in Active Touch Task , 2018, EuroHaptics.

[38]  Thomas W. James,et al.  Dorsal and Ventral Cortical Pathways for Visuo-haptic Shape Integration Revealed Using fMRI , 2010 .

[39]  C E Chapman,et al.  Active versus passive touch: factors influencing the transmission of somatosensory signals to primary somatosensory cortex. , 1994, Canadian journal of physiology and pharmacology.

[40]  L. Cohen,et al.  Neuroplasticity in the context of motor rehabilitation after stroke , 2011, Nature Reviews Neurology.

[41]  Michael T. Jurkiewicz,et al.  Post-movement beta rebound is generated in motor cortex: Evidence from neuromagnetic recordings , 2006, NeuroImage.

[42]  Michelle N. Lumicao,et al.  EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. , 2007, Aviation, space, and environmental medicine.

[43]  M. Hallett,et al.  Role of the Ipsilateral Motor Cortex in Voluntary Movement , 1997, Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques.

[44]  Xiaoying Sun,et al.  Effect of Electrostatic Tactile Feedback on Accuracy and Efficiency of Pan Gestures on Touch Screens , 2018, IEEE Transactions on Haptics.

[45]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[46]  M. Hollins,et al.  Evidence for the duplex theory of tactile texture perception , 2000, Perception & psychophysics.

[47]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[48]  E. Maris,et al.  Orienting Attention to an Upcoming Tactile Event Involves a Spatially and Temporally Specific Modulation of Sensorimotor Alpha- and Beta-Band Oscillations , 2011, The Journal of Neuroscience.

[49]  Cristina Simões-Franklin,et al.  Active and passive touch differentially activate somatosensory cortex in texture perception , 2011, Human brain mapping.