Review of Interfaces for Industrial Human-Robot Interaction

The review presents an overview of research approaches on human-robot interfaces in industrial and service robotics. Research approaches address especially speech and gesture recognition in both fields but are more explored in service robotics. However, the importance of interfaces in industrial robots increases. The development of human-robot interfaces is leading towards intuitive interfaces, especially using speech and gesture recognition and combining them to multimodal interfaces.

[1]  Xinjun Sheng,et al.  Feasibility of Wrist-Worn, Real-Time Hand, and Surface Gesture Recognition via sEMG and IMU Sensing , 2018, IEEE Transactions on Industrial Informatics.

[2]  Keith S. Jones,et al.  Human-Robot Interaction Toward Usable Personal Service Robots , 2011 .

[3]  Lihui Wang,et al.  Gesture recognition for human-robot collaboration: A review , 2017, International Journal of Industrial Ergonomics.

[4]  Andreas Dömel,et al.  RAFCON: A graphical tool for engineering complex, robotic tasks , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  Siddhartha S. Srinivasa,et al.  HARMONIC: A multimodal dataset of assistive human–robot collaboration , 2018, Int. J. Robotics Res..

[6]  Dominik Henrich,et al.  Editing and synchronizing multi-robot playback programs , 2016 .

[7]  Sotiris Makris,et al.  Human–robot interaction review and challenges on task planning and programming , 2016, Int. J. Comput. Integr. Manuf..

[8]  Gordon Cheng,et al.  A Tactile-Based Framework for Active Object Learning and Discrimination using Multimodal Robotic Skin , 2017, IEEE Robotics and Automation Letters.

[9]  Christoph Bartneck,et al.  You just do not understand me! Speech Recognition in Human Robot Interaction , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[10]  Johannes Hügle,et al.  An integrated approach for industrial robot control and programming combining haptic and non-haptic gestures , 2017, 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[11]  Jan Peters,et al.  Multimodal Uncertainty Reduction for Intention Recognition in Human-Robot Interaction , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Alois Knoll,et al.  An integrated framework for multimodal human-robot interaction , 2017, 2017 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[13]  Kerstin Dautenhahn,et al.  Methodology & Themes of Human-Robot Interaction: A Growing Research Field , 2007 .

[14]  Peng Zhang,et al.  Human–machine interfaces , 2010 .

[15]  Francesco Leali,et al.  Survey on human–robot collaboration in industrial settings: Safety, intuitive interfaces and applications , 2018, Mechatronics.

[16]  Mohamed Chetouani,et al.  Towards Engagement Models that Consider Individual Factors in HRI: On the Relation of Extroversion and Negative Attitude Towards Robots to Gaze and Speech During a Human–Robot Assembly Task , 2015, Int. J. Soc. Robotics.

[17]  Constantine Stephanidis,et al.  Applying a Multimodal User Interface Development Framework on a Domestic Service Robot , 2017, PETRA.

[18]  Sebastian Thrun,et al.  A Gesture Based Interface for Human-Robot Interaction , 2000, Auton. Robots.

[19]  Sasa Bodiroza.  Gestures in human-robot interaction: development of intuitive gesture vocabularies and robust gesture recognition , 2017 .

[20]  Alexander H. Waibel,et al.  Towards spontaneous speech recognition for on-board car navigation and information systems , 1999, EUROSPEECH.

[21]  Jessica Lindblom,et al.  Classification of Collaboration Levels for Human-Robot Cooperation in Manufacturing , 2018 .

[22]  Elizabeth A. Croft,et al.  Cooperative gestures for industry: Exploring the efficacy of robot hand configurations in expression of instructional gestures for human–robot interaction , 2017, Int. J. Robotics Res..

[23]  Olivier Gibaru,et al.  Natural control of an industrial robot using hand gesture recognition with neural networks , 2016, IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society.

[24]  Gunther Reinhart,et al.  An Integrated Planning and Programming System for Human-Robot-Cooperation☆ , 2017 .

[25]  You Zhou,et al.  ARMAR-6: A High-Performance Humanoid for Human-Robot Collaboration in Real-World Scenarios , 2019, IEEE Robotics & Automation Magazine.

[26]  Mi-Young Cho,et al.  Human gesture recognition performance evaluation for service robots , 2017, 2017 19th International Conference on Advanced Communication Technology (ICACT).

[27]  Teodiano Freire Bastos Filho,et al.  Multimodal Human–Robot Interaction for Walker-Assisted Gait , 2016, IEEE Systems Journal.

[28]  Klaus Bengler,et al.  Human Centered Assistance Applications for the working environment of the future , 2015 .

[29]  Kun Qian,et al.  Developing a Gesture Based Remote Human-Robot Interaction System Using Kinect , 2013 .

[30]  Gilbert Tang,et al.  The Design and Evaluation of an Ergonomic Contactless Gesture Control System for Industrial Robots , 2018, J. Robotics.

[31]  Mirko Wächter,et al.  The ArmarX Statechart Concept: Graphical Programing of Robot Behavior , 2016, Front. Robot. AI.

[32]  Alberto Tellaeche,et al.  Natural multimodal communication for human–robot collaboration , 2017 .

[33]  Jürgen Roßmann,et al.  A Methodology for the Planning and Implementation of Service Robotics in Industrial Work Processes , 2014 .

[34]  Adnan Khashman,et al.  Deep learning in vision-based static hand gesture recognition , 2017, Neural Computing and Applications.

[35]  Sergio Escalera,et al.  A real-time Human-Robot Interaction system based on gestures for assistive scenarios , 2016, Comput. Vis. Image Underst..

[36]  Alin Albu-Schäffer,et al.  The DLR lightweight robot: design and control concepts for robots in human environments , 2007, Ind. Robot.

[37]  Germano Veiga,et al.  Programming-by-demonstration in the coworker scenario for SMEs , 2009, Ind. Robot.

[38]  Christoph Richter,et al.  Human-Robot-Interaction for mobile industrial robot teams , 2019, Procedia CIRP.

[39]  Horst-Michael Groß,et al.  An approach to multi-modal human-machine interaction for intelligent service robots , 2003, Robotics Auton. Syst..

[40]  A. Kaya,et al.  Cosmological backreaction of a quantized massless scalar field , 2011, 1111.2511.

[41]  Michael A. Goodrich,et al.  Human-Robot Interaction: A Survey , 2008, Found. Trends Hum. Comput. Interact..

[42]  Ivo Stani,et al.  Gesture recognition system for real-time mobile robot control based on inertial sensors and motion strings , 2017 .

[43]  Sami Haddadin,et al.  Physical Human-Robot Interaction , 2016, Springer Handbook of Robotics, 2nd Ed..

[44]  V. Vasu,et al.  Human Machine Interface for controlling a robot using image processing , 2014 .

[45]  Tony Belpaeme,et al.  Child Speech Recognition in Human-Robot Interaction: Evaluations and Recommendations , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[46]  H. Gunes,et al.  Multimodal Human-Human-Robot Interactions (MHHRI) Dataset for Studying Personality and Engagement , 2019, IEEE Transactions on Affective Computing.

[47]  M. A. Viraj J. Muthugala,et al.  A Review of Service Robots Coping With Uncertain Information in Natural Language Instructions , 2018, IEEE Access.

[48]  Rami Matarneh,et al.  Voice Control for an Industrial Robot as a Combination of Various Robotic Assembly Process Models , 2017 .

[49]  Gordon Cheng,et al.  A computational model of human decision making and learning for assessment of co-adaptation in neuro-adaptive human-robot interaction , 2019, 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC).

[50]  António J. R. Neves,et al.  Human-Robot Interaction Based on Gestures for Service Robots , 2017 .

[51]  Sotiris Makris,et al.  High Level Robot Programming Using Body and Hand Gestures , 2016 .

[52]  Bodo Urban,et al.  Using Hand Gestures to Interact with an Industrial Robot in a Cooperative Flexible Manufacturing Scenario , 2017, ICMRE 2017.