Toward a Wearable Biosensor Ecosystem on ROS 2 for Real-time Human-Robot Interaction Systems

Wearable biosensors can enable continuous human data capture, facilitating development of real-world human-robot interaction (HRI) systems. However, a lack of standardized libraries and implementations adds extraneous complexity to HRI system designs, and precludes collaboration across disciplines and institutions. Here, we introduce a novel wearable biosensor package for the Robot Operating System 2 (ROS 2) system. The ROS 2 officially supports real-time computing and multi-robot systems, and thus provides easy-to-use and reliable streaming data from multiple nodes. The package standardizes biosensor HRI integration, lowers the technical barrier of entry, and expands the biosensor ecosystem into the robotics field. Each biosensor package node follows a generalized node and topic structure concentrated on ease of use. Current package capabilities, listed by biosensor, highlight package standardization. Collected example data demonstrate a full integration of each biosensor into ROS 2. We expect that standardization of this biosensors package for ROS 2 will greatly simplify use and cross-collaboration across many disciplines. The wearable biosensor package is made publicly available on GitHub at https://github.com/SMARTlab-Purdue/ ros2-foxy-wearable-biosensors.

[1]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[2]  Seongcheol Kim,et al.  Is the smartwatch an IT product or a fashion product? A study on factors affecting the intention to use smartwatches , 2016, Comput. Hum. Behav..

[3]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[4]  Sang Min Lee,et al.  Development BCI for individuals with severely disability using EMOTIV EEG headset and robot , 2014, 2014 International Winter Workshop on Brain-Computer Interface (BCI).

[5]  B. Min,et al.  ROSbag-based Multimodal Affective Dataset for Emotional and Cognitive States , 2020, 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[6]  Vishnu Sashank Dorbala,et al.  ProxEmo: Gait-based Emotion Learning and Multi-view Proxemic Fusion for Socially-Aware Robot Navigation , 2020, IEEE/RJS International Conference on Intelligent RObots and Systems.

[7]  Byung-Cheol Min,et al.  A ROS-based Framework for Monitoring Human and Robot Conditions in a Human-Multi-robot Team , 2020, ArXiv.

[8]  Nilanjan Dey,et al.  Identification of Suitable Biomarkers for Stress and Emotion Detection for Future Personal Affective Wearable Sensors , 2020, Biosensors.

[9]  Mehrdad Nourani,et al.  A Motion-Tolerant Adaptive Algorithm for Wearable Photoplethysmographic Biosensors , 2014, IEEE Journal of Biomedical and Health Informatics.

[10]  Xiaonan Guo,et al.  FitCoach: Virtual fitness coach empowered by wearable mobile devices , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[11]  Noa Agmon,et al.  Intelligent agent supporting human-multi-robot team collaboration , 2015, Artif. Intell..

[12]  Cesare Furlanello,et al.  pyphysio: A physiological signal processing library for data science approaches in physiology , 2019, SoftwareX.

[13]  Ana Paiva,et al.  Sensors in the wild: Exploring electrodermal activity in child-robot interaction , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[14]  Byung-Cheol Min,et al.  Adaptive Workload Allocation for Multi-Human Multi-Robot Teams for Independent and Homogeneous Tasks , 2020, IEEE Access.

[15]  Simon J. Julier,et al.  Everybody Needs Somebody Sometimes: Validation of Adaptive Recovery in Robotic Space Operations , 2019, IEEE Robotics and Automation Letters.

[16]  Jan C. Brammer,et al.  NeuroKit2: A Python toolbox for neurophysiological signal processing. , 2021, Behavior research methods.

[17]  Yang Wang,et al.  Multimodal behavior and interaction as indicators of cognitive load , 2012, TIIS.

[18]  James Humann,et al.  Human Factors in the Scalability of Multirobot Operation: A Review and Simulation , 2019, 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC).

[19]  Itziar Cabanes,et al.  Human-Robot Interaction Review: Challenges and Solutions for Modern Industrial Environments , 2021, IEEE Access.

[20]  Dinesh Manocha,et al.  Modelling Multi-Channel Emotions Using Facial Expression and Trajectory Cues for Improving Socially-Aware Robot Navigation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).