Visuo-haptic transmission of contact information improve operation of Active Scope Camera

Disaster response robots for searching in a narrow area have limited space to mount tactile sensors, but the operators require sensory feedback to recognize contact situations with the surrounding environment. This study proposes a new approach to transmitting contact information of a remote-operated snake-like robot called Active Scope Camera (ASC) to the operator using simple configurations for the sensing and display methods. For the sensing side, we develop a contact estimation method with a limited number of tactile sensors. We establish the method to localize the contact position and the magnitude by sensing multiple propagated vibrations based on experiments and formulations. Preliminary experiments show that the developed method estimates a collision angle with high probability (93.8% at the worst condition) at several collisional situations. For the display side, we combine visual and vibrotactile feedback to provide the operator both directional and temporal cues to perceive contact events. The proposed visualization method uses colored bars, peripherally superposed on the video image, to show the estimated contact location and magnitude. A single DoF vibrotactile feedback is used for a joystick interface to control the head movement of the ASC. The effect of vibrotactile feedback on the response time to contact events is evaluated. Finally, we investigate the performance of the operation by identifying the contact behavior at simulated scenarios. Experimental results show that collision times per operation time is decreased by the developed feedback system compared with a simple video-based operation.

[1]  Matthew O. Ward,et al.  Enhancing robot teleoperator situation awareness and performance using vibro-tactile and graphical feedback , 2011, 2011 IEEE Symposium on 3D User Interfaces (3DUI).

[2]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[3]  Kazuya Yoshida,et al.  Collaborative mapping of an earthquake‐damaged building via ground and aerial robots , 2012, J. Field Robotics.

[4]  J. Sibert,et al.  Vibrotactile Feedback for Enhanced Control of Urban Search and Rescue Robots , 2007 .

[5]  Jessie Y. C. Chen,et al.  Human Performance Issues and User Interface Design for Teleoperated Robots , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[6]  Robin R. Murphy,et al.  Trial by fire [rescue robots] , 2004, IEEE Robotics & Automation Magazine.

[7]  Howie Choset,et al.  Generating gaits for snake robots: annealed chain fitting and keyframe wave extraction , 2010, Auton. Robots.

[8]  Robin R. Murphy,et al.  Crew roles and operational protocols for rotary-wing micro-UAVs in close urban environments , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[9]  Katherine J. Kuchenbecker,et al.  Tool Contact Acceleration Feedback for Telerobotic Surgery , 2011, IEEE Transactions on Haptics.

[10]  Eijiro Takeuchi,et al.  Remote vertical exploration by Active Scope Camera into collapsed buildings , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Satoshi Tadokoro,et al.  Active scope camera for urban search and rescue , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Kazuya Yoshida,et al.  Emergency response to the nuclear accident at the Fukushima Daiichi Nuclear Power Plants using mobile rescue robots , 2013, J. Field Robotics.

[13]  Satoshi Tadokoro,et al.  Tube-type active scope camera with high mobility and practical functionality , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Yoshinori Tanaka,et al.  Development of “Souryu‐IV” and “Souryu‐V:” Serially connected crawler vehicles for in‐rubble searching operations , 2008, J. Field Robotics.

[15]  Norman I. Badler,et al.  Collision Awareness Using Vibrotactile Arrays , 2007, 2007 IEEE Virtual Reality Conference.

[16]  Ali Israr,et al.  Tactile brush: drawing on skin with a tactile grid display , 2011, CHI.

[17]  Satoshi Tadokoro,et al.  Ciliary Vibration Drive Mechanism for Active Scope Cameras , 2008, J. Robotics Mechatronics.

[18]  Satoshi Tadokoro,et al.  Detectability and Perceptual Consequences of Delayed Feedback in a Vibrotactile Texture Display , 2009, IEEE Transactions on Haptics.

[19]  Kinya Fujita,et al.  Virtual object manipulation system with substitutive display of tangential force and slip by control of vibrotactile phantom sensation , 2010, 2010 IEEE Haptics Symposium.