Simulated robotic device malfunctions resembling malicious cyberattacks impact human perception of trust, satisfaction, and frustration

Robot assistants and wearable devices are highly useful; however, these artificial systems are susceptible to hackers. In this article, two sets of experiments were conducted. The first part of this study simulated a malicious attack on a prosthetic arm system to adversely affect the operation of the prosthetic system, while the perception of 10 human subjects was surveyed. These 10 able-bodied subjects controlled the prosthetic arm and hand with electromyogram signals, while an artificial sensation of touch was conveyed to their arms as they operated the system, which enabled them to feel what the prosthetic hand was grasping as they were asked to transport an object from one location to another. This haptic feedback was provided in both the normal and abnormal operational modes but was disabled in the extremely abnormal mode. The electromyogram control signals for the arm were reversed in both the abnormal and extremely abnormal modes. Results from the simulated malicious attack on a prosthetic arm system showed that the subjects found the haptic feedback helpful in both the normal and abnormal modes of operation. Both the abnormal and extremely abnormal modes of operation negatively impacted the self-reported levels of trust, satisfaction, and frustration with the prosthetic system as the subjects grasped and transported an object. While these metrics were negatively impacted by system malfunctions resembling a malicious attack on the control functionality, it was possible to rebuild them to their former higher levels after the functionality of the prosthetic system was restored. A parallel study in this article involved simulating a malicious attack on a robot assistant to unfavorably affect the delivery operation modes, while the perception of 20 human subjects was surveyed. Results showed that the simulated malfunctions unfavorably impacted the perception of trust, satisfaction, and frustration, but it was possible to restore these metrics in two different ways as the device functionality was restored.

[1]  P. Kyberd,et al.  A Survey of Upper-Limb Prosthesis Users in Oxfordshire , 1998 .

[2]  William D. Smart,et al.  Robots for humanity: using assistive robotics to empower people with disabilities , 2013, IEEE Robotics & Automation Magazine.

[3]  Huosheng Hu,et al.  Myoelectric control systems - A survey , 2007, Biomed. Signal Process. Control..

[4]  Keehoon Kim,et al.  Haptic Feedback Enhances Grip Force Control of sEMG-Controlled Prosthetic Hands in Targeted Reinnervation Amputees , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  Erik D. Engeberg,et al.  Backdrivable periodic finger joint synergies: Human observations applied to a dexterous robotic hand , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[6]  Kathryn Ziegler-Graham,et al.  Estimating the prevalence of limb loss in the United States: 2005 to 2050. , 2008, Archives of physical medicine and rehabilitation.

[7]  L. Hermansson,et al.  Psychosocial adjustment in Swedish children with upper-limb reduction deficiency and a myoelectric prosthetic hand. , 2005, Acta paediatrica.

[8]  Giulio Sandini,et al.  Tactile Sensing—From Humans to Humanoids , 2010, IEEE Transactions on Robotics.

[9]  Jonathan Rossiter,et al.  The TacTip Family: Soft Optical Tactile Sensors with 3D-Printed Biomimetic Morphologies , 2018, Soft robotics.

[10]  Jiafu Wan,et al.  Security in the Internet of Things: A Review , 2012, 2012 International Conference on Computer Science and Electronics Engineering.

[11]  Michael Bornstein,et al.  Armband with Soft Robotic Actuators and Vibrotactile Stimulators for Bimodal Haptic Feedback from a Dexterous Artificial Hand , 2018, 2018 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[12]  Kapil D. Katyal,et al.  Individual finger control of a modular prosthetic limb using high-density electrocorticography in a human subject , 2016, Journal of neural engineering.

[13]  Ronald S. Ross,et al.  Guide for Conducting Risk Assessments , 2012 .

[14]  Christine Connolly,et al.  Prosthetic hands from Touch Bionics , 2008, Ind. Robot.

[15]  Athanasios V. Vasilakos,et al.  Security of the Internet of Things: perspectives and challenges , 2014, Wireless Networks.

[16]  N.V. Thakor,et al.  Quantifying Prosthesis Control Improvements Using a Vibrotactile Representation of Grip Force , 2008, 2008 IEEE Region 5 Conference.

[17]  Linda Resnik,et al.  The DEKA Arm: Its features, functionality, and evolution during the Veterans Affairs Study to optimize the DEKA Arm , 2014, Prosthetics and orthotics international.

[18]  Corry K van der Sluis,et al.  Age at First Prosthetic Fitting and Later Functional Outcome in Children and Young Adults with Unilateral Congenital Below-Elbow Deficiency: A Cross-Sectional Study , 2010, Prosthetics and orthotics international.

[19]  O. Stavdahl,et al.  Control of Upper Limb Prostheses: Terminology and Proportional Myoelectric Control—A Review , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Ou Bai,et al.  Robotic Finger Force Sensor Fabrication and Evaluation Through a Glove. , 2018, Proceedings. Florida Conference on Recent Advances in Robotics.

[21]  Yier Jin,et al.  Privacy and Security in Internet of Things and Wearable Devices , 2015, IEEE Transactions on Multi-Scale Computing Systems.

[22]  Christian Balkenius,et al.  Transfer of tactile input from an artificial hand to the forearm: experiments in amputees and able-bodied volunteers , 2013, Disability and rehabilitation. Assistive technology.

[23]  John T. Wen,et al.  Human-directed coordinated control of an assistive mobile manipulator , 2016, International Journal of Intelligent Robotics and Applications.

[24]  Marcia Kilchenman O'Malley,et al.  Tactile feedback of object slip improves performance in a grasp and hold task , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[25]  Mehrdad Nojoumian,et al.  Human Trust Measurement Using an Immersive Virtual Reality Autonomous Vehicle Simulator , 2019, AIES.

[26]  Agnès Roby-Brami,et al.  Can We Achieve Intuitive Prosthetic Elbow Control Based on Healthy Upper Limb Motor Strategies? , 2018, Front. Neurorobot..

[27]  Luigi Alfredo Grieco,et al.  Security, privacy and trust in Internet of Things: The road ahead , 2015, Comput. Networks.

[28]  Mehrdad Nojoumian.  Trust, Influence and Reputation Management Based on Human Reasoning , 2015, AAAI Workshop: Incentive and Trust in E-Communities.

[29]  David Whalen,et al.  Jamster: A mobile dual-arm assistive robot with Jamboxx control , 2014, 2014 IEEE International Conference on Automation Science and Engineering (CASE).

[30]  J. Davidson.  A survey of the satisfaction of upper limb amputees with their prostheses, their lifestyles, and their abilities. , 2002, Journal of hand therapy : official journal of the American Society of Hand Therapists.

[31]  Thierry Keller,et al.  Electrotactile Feedback Improves Performance and Facilitates Learning in the Routine Grasping Task , 2016, European journal of translational myology.

[32]  Dario Farina,et al.  Electrotactile EMG feedback improves the control of prosthesis grasping force , 2016, Journal of neural engineering.

[33]  Taekyoung Kwon,et al.  Data Transfusion: Pairing Wearable Devices and Its Implication on Security for Internet of Things , 2018, IEEE Access.

[34]  Tadayoshi Kohno,et al.  Neurosecurity: security and privacy for neural devices. , 2009, Neurosurgical focus.

[35]  Jacob L. Segil,et al.  Mechanical design and performance specifications of anthropomorphic prosthetic hands: a review. , 2013, Journal of rehabilitation research and development.

[36]  Erik D. Engeberg,et al.  Robotic Hand Acceleration Feedback to Synergistically Prevent Grasped Object Slip , 2017, IEEE Transactions on Robotics.

[37]  G. Lundborg,et al.  Sensory feedback from a prosthetic hand based on air-mediated pressure from the hand to the forearm skin. , 2012, Journal of rehabilitation medicine.

[38]  Manfredo Atzori,et al.  Control Capabilities of Myoelectric Robotic Prostheses by Hand Amputees: A Scientific Research and Market Overview , 2015, Front. Syst. Neurosci..

[39]  Bert-Jaap Koops,et al.  Attacking Human Implants: A New Generation of Cybercrime , 2013 .

[40]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[41]  Erik D. Engeberg,et al.  Biologically inspired posture control for a dexterous robotic hand , 2011, 2011 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[42]  David Alan Boone,et al.  Development and Real World Use of a Vibratory Haptic Feedback System for Upper-Limb Prosthetic Users , 2016 .

[43]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[44]  Gerald E. Loeb,et al.  Bayesian Exploration for Intelligent Identification of Textures , 2012, Front. Neurorobot..

[45]  David Alan Boone,et al.  Closed-Loop Vibratory Haptic Feedback in Upper-Limb Prosthetic Users , 2014 .

[46]  Jason Friedman,et al.  Visuomotor behaviors and performance in a dual-task paradigm with and without vibrotactile feedback when using a myoelectric controlled hand , 2018, Assistive technology : the official journal of RESNA.

[47]  Edward Roback,et al.  SP 800-12. An Introduction to Computer Security: the NIST Handbook , 1995 .

[48]  Thierry Keller,et al.  Sensor fusion and computer vision for context-aware control of a multi degree-of-freedom prosthesis , 2016 .

[49]  P. Kyberd,et al.  Survey of Upper-Extremity Prosthesis Users in Sweden and the United Kingdom , 2007 .

[50]  E. Biddiss,et al.  Upper limb prosthesis use and abandonment: A survey of the last 25 years , 2007, Prosthetics and orthotics international.

[51]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[52]  Dingguo Zhang,et al.  Effects of Different Tactile Feedback on Myoelectric Closed-Loop Control for Grasping Based on Electrotactile Stimulation , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[53]  Neil M. Bajaj,et al.  State of the Art in Artificial Wrists: A Review of Prosthetic and Robotic Wrist Design , 2019, IEEE Transactions on Robotics.

[54]  Mehrdad Nojoumian,et al.  Impacts of Robot Assistant Performance on Human Trust , Satisfaction , and Frustration , 2017 .

[55]  Matteo Bianchi,et al.  Influence of force feedback on grasp force modulation in prosthetic applications: A preliminary study , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).