Haptics and virtual reality based bilateral telemanipulation of miniature aerial vehicle over open communication network

In this paper, we develop haptic interface system for bilateral telemanipulation of unmanned miniature aerial vehicle (MAV). The proposed interface allows operator to navigate MAV in order to control and interact with uncertain indoor flying environments without using vision systems. The master interface combines bilateral shared control terms with the reflected remote interaction force fields mapped by two different types of force field algorithms as potential force field and spring-damper force field. The shared control strategy for the master comprises velocity signals of the remote MAV with the scaled position of the master haptic manipulator. The bilateral shared input interface for the slave is designed by combining scaled position of the master manipulator with the velocity of the remote MAV. The data transmission between ground station and remote vehicle are carried out by open internet communication network. In contrast with other haptic interface system, the proposed interface system only uses laser technology equipped with the slave MAV. Compared with potential force field based interface, the interface introduced in this paper provides better situational awareness about remote environment helping operator to navigate and control MAV for safe interaction with uncertain indoor dynamic environment. Experimental results together with comparative studies on laboratory made quadrotor MAV are presented to demonstrate the effectiveness of the proposed methods for real-time applications.

[1]  Nikolaos Papanikolopoulos,et al.  Experimental investigation of teleoperation performance for miniature rotorcraft , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[2]  Stefano Stramigioli,et al.  Kinetic scrolling-based position mapping for haptic teleoperation of unmanned aerial vehicles , 2012, 2012 IEEE International Conference on Robotics and Automation.

[3]  Peter I. Corke,et al.  A new framework for force feedback teleoperation of robotic vehicles based on optical flow , 2009, 2009 IEEE International Conference on Robotics and Automation.

[4]  Berthold K. P. Horn Robot vision , 1986, MIT electrical engineering and computer science series.

[5]  Oussama Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1986 .

[6]  Peter Xiaoping Liu,et al.  Teleoperation Systems With Symmetric and Unsymmetric Time Varying Communication Delay , 2013, IEEE Transactions on Instrumentation and Measurement.

[7]  Bin Yao,et al.  Teleoperation of a Mobile Robot Using a Force-Reflection Joystick With Sensing Mechanism of Rotating Magnetic Field , 2010, IEEE/ASME Transactions on Mechatronics.

[8]  Antonio Franchi,et al.  A semi-autonomous UAV platform for indoor remote operation with visual and haptic feedback , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Oussama Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Autonomous Robot Vehicles.

[10]  René van Paassen,et al.  Collision avoidance in UAV tele-operation with time delay , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[11]  René van Paassen,et al.  Artificial Force Field for Haptic Feedback in UAV Teleoperation , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[12]  A. El Saddik,et al.  Nonlinear adaptive control for quadrotor flying vehicle , 2014 .

[13]  Antonio Franchi,et al.  Vision-based Autonomous Control of a Quadrotor UAV using an Onboard RGB-D Camera and its Application to Haptic Teleoperation , 2013 .

[14]  Christoph Hürzeler,et al.  Teleoperation Assistance for an Indoor Quadrotor Helicopter , 2008 .

[15]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[16]  John M. Hollerbach,et al.  Planning of Minimum- Time Trajectories for Robot Arms , 1986 .

[17]  Nikolaos Papanikolopoulos,et al.  A First Investigation into the Teleoperation of a Miniature Rotorcraft , 2009, ISER.