Wearable Augmented Reality and Brain Computer Interface to Improve Human-Robot Interactions in Smart Industry: A Feasibility Study for SSVEP Signals

Augmented Reality (AR) offers a new communication channel, capable of enhancing human-robot interactions. A Brain-Computer Interface (BCI) can be particularly effective to interact with an AR headset, essentially working as a “thinking-mouse” and allowing hands-free control of the system, so that the operator can simultaneously carry out other tasks. In this paper, the feasibility of employing smart glasses driven by Steady-State Visually Evoked Potentials (SSVEP) non-invasive single-channel BCI is assessed in order to enhance the human-robot interaction in the Industry 4.0 framework. In particular, we demonstrate that smart glasses can generate a stimulus signal enough stable in frequency and bright to evoke SSVEP in the BCI user's brain. For the experimental AR case study of this work, the smart glasses Epson Moverio BT-200 were employed.

[1]  Iñaki Iturrate,et al.  A Noninvasive Brain-Actuated Wheelchair Based on a P300 Neurophysiological Protocol and Automated Navigation , 2009, IEEE Transactions on Robotics.

[2]  Karla Felix Navarro,et al.  Wearable, wireless brain computer interfaces in augmented reality environments , 2004, International Conference on Information Technology: Coding and Computing, 2004. Proceedings. ITCC 2004..

[3]  Deniz Erdogmus,et al.  The Future of Human-in-the-Loop Cyber-Physical Systems , 2013, Computer.

[4]  László Monostori,et al.  ScienceDirect Variety Management in Manufacturing . Proceedings of the 47 th CIRP Conference on Manufacturing Systems Cyber-physical production systems : Roots , expectations and R & D challenges , 2014 .

[5]  Doron Friedman,et al.  Brain-Computer Interfacing and Virtual Reality , 2015 .

[6]  D. W. F. van Krevelen,et al.  A Survey of Augmented Reality Technologies, Applications and Limitations , 2010, Int. J. Virtual Real..

[7]  Ferran Argelaguet,et al.  Brain-Computer Interfaces and Augmented Reality: a State of the Art , 2017, GBCIC.

[8]  T. D. Sunny,et al.  Robotic Arm with Brain – Computer Interfacing , 2016 .

[9]  Anand Sánchez-Orta,et al.  On the Brain Computer Robot Interface (BCRI) to Control Robots , 2015, SyRoCo.

[10]  Roland Siegwart,et al.  Article in Press Robotics and Autonomous Systems ( ) – Robotics and Autonomous Systems Brain-coupled Interaction for Semi-autonomous Navigation of an Assistive Robot , 2022 .

[11]  Wendong Xu,et al.  Scientific profile of brain–computer interfaces: Bibliometric analysis in a 10-year period , 2016, Neuroscience Letters.

[12]  Yili Liu,et al.  EEG-Based Brain-Controlled Mobile Robots: A Survey , 2013, IEEE Transactions on Human-Machine Systems.

[13]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[14]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[15]  Amy J. C. Trappey,et al.  Immersive Technology for Human-Centric Cyberphysical Systems in Complex Manufacturing Processes: A Comprehensive Overview of the Global Patent Profile Using Collective Intelligence , 2018, Complex..

[16]  Bogdan-Constantin Pirvu,et al.  Engineering insights from an anthropocentric cyber-physical system: A case study for an assembly station , 2016 .