New interaction metaphors to control a hydraulic working machine's arm

In the last decade, teleoperated hydraulic machines have become a reality in post-disaster scenarios. Although Human Machine Interaction technologies had huge advances, these technologies are not always applied successfully, especially in fields in which automation or semi-automation have difficulties to make their way, i.e. unstructured scenarios. This paper aims to introduce new interaction metaphors to improve operation of modern teleoperated hydraulic machines. Three new prototypes of Human Machine Interfaces are presented: a wireless portable joystick, a wearable hand motion recognition system and two facing haptic interfaces. The interfaces are evaluated in a typical pick and place scenario, developed with the aid of Virtual Reality. The results are discussed from an ergonomic and task performance point of view. The wireless portable joystick and the haptic interface produced similar outcomes and they are both usable for the control, whereas the wearable hand motion control proved to be unsuitable the task.

[1]  Daehie Hong,et al.  Novel design of haptic devices for bilateral teleoperated excavators using the wave-variable method , 2013 .

[2]  Carlo Alberto Avizzano,et al.  A novel 7 degrees of freedom model for upper limb kinematic reconstruction based on wearable sensors , 2013, 2013 IEEE 11th International Symposium on Intelligent Systems and Informatics (SISY).

[3]  V. I. Pavlenko,et al.  Dismantling of Loop-Type Channel Equipment of MR Reactor in NRC 'Kurchatov Institute' - 13040 , 2013 .

[4]  Shigeki Sugano,et al.  Development of a tele-operation simulator based on virtual reality environment for advanced unmanned construction , 2013, Proceedings of the 2013 IEEE/SICE International Symposium on System Integration.

[5]  Wayne J. Book,et al.  A Practical Interface for Coordinated Position Control of an Excavator Arm. , 2015 .

[6]  Basilio Sierra,et al.  Using Virtual Reality for Gesture and Vocal Interface Validation in Industrial Environments , 2007 .

[7]  Massimo Bergamasco,et al.  A Flexible Framework for WideSpectrum VR Development , 2010, PRESENCE: Teleoperators and Virtual Environments.

[8]  Wayne J. Book,et al.  Comparison of human-machine interfaces designed for novices teleoperating multi-DOF hydraulic manipulators , 2011, 2011 RO-MAN.

[9]  Steven Martin,et al.  Characterisation of the Novint Falcon Haptic Device for Application as a Robot Manipulator , 2009 .

[10]  Carlo Alberto Avizzano,et al.  A novel human-machine interface for working machines operation , 2013, 2013 IEEE RO-MAN.

[11]  Ahmad Anas Yusof,et al.  Modern practical application and research on teleoperated excavators control, feedback and perception issues in post disaster recovery operation , 2015, 2015 IEEE International Symposium on Robotics and Intelligent Sensors (IRIS).

[12]  Dieter Schwarzmann,et al.  Control Concept for a Hydraulic Mobile Machine Using a Haptic Operating Device , 2009, 2009 Second International Conferences on Advances in Computer-Human Interactions.

[13]  Jongwon Kim,et al.  Excavator tele-operation system using a human arm , 2009 .

[14]  Kalevi Huhtala,et al.  Teleoperation interfaces for a remote controlled hydraulic mobile machine , 2003, Proceedings 2003 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM 2003).

[15]  Robert Bogue,et al.  Robots in the nuclear industry: a review of technologies and applications , 2011, Ind. Robot.

[16]  C. J. Taylor,et al.  State-dependent control of a hydraulically-actuated nuclear decommissioning robot , 2012, Proceedings of 2012 UKACC International Conference on Control.

[17]  Robert Bogue,et al.  Industrial Robot : An International Journal Search and rescue and disaster relief robots : has their time finally come ? , 2016 .

[18]  Tae Suk Yoo,et al.  Gain-Scheduled Complementary Filter Design for a MEMS Based Attitude and Heading Reference System , 2011, Sensors.

[19]  Paolo Simone Gasparello,et al.  Description and Performance Analysis of a Distributed Rendering Architecture for Virtual Environments , 2007 .

[20]  Massimo Satler,et al.  A Haptic-Assisted Guidance System for working machines based on virtual force fields , 2015, 2015 XXV International Conference on Information, Communication and Automation Technologies (ICAT).