Information visualization based on 3D modeling for human-friendly teleoperation

This paper proposes a method for 3D modeling of environments used to perform teleoperation of a mobile robot. Recently, the expectation to tele-operated mobile robots has been increasing much in order to perform a monitoring in various scenes. However, there are many critical problems in tele-operated systems. Especially, we must expand visual range from a robot, the usability of human interface, and intention sharing between the robot and operator. First, we discuss information visualization for human-friendly tele-operation. Next, we propose a tele-operating system based on multi-resolution map. Finally, we propose a method of 3D modeling using Microsoft Kinect sensor, and show several experimental results of the proposed method.

[1]  Naoyuki Kubota,et al.  Multi-scale intelligent information processing for multi-robot system based on human-friendly tele-operation , 2011, 2011 International Symposium on Micro-NanoMechatronics and Human Science.

[2]  Fumio Kojima,et al.  Multiple fuzzy state-value functions for human evaluation through interactive trajectory planning of a partner robot , 2006, Soft Comput..

[3]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[4]  Jean Scholtz,et al.  Evaluation of human-robot interaction awareness in search and rescue , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[5]  Andreas Birk,et al.  The IUB Rugbot: an intelligent, rugged mobile robot for search and rescue operations , 2006 .

[6]  N Kubota,et al.  Human-friendly tele-operation for robot partners , 2011 .

[7]  Sebastian Thrun,et al.  Learning Occupancy Grid Maps with Forward Sensor Models , 2003, Auton. Robots.

[8]  Naoyuki Kubota,et al.  Intelligent Control of multi-agent system based on multi-objective behavior coordination , 2008, 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence).

[9]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[10]  N. Kubota,et al.  Human-Friendly Networked Partner Robots toward Sophisticated Services for A Community , 2006, 2006 SICE-ICASE International Joint Conference.

[11]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[12]  Wan Kyun Chung,et al.  Effective Maximum Likelihood Grid Map With Conflict Evaluation Filter Using Sonar Sensors , 2009, IEEE Transactions on Robotics.

[13]  Naoyuki Kubota,et al.  Multifeatured visualization and navigation in tele-operation of mobile robots , 2011, 2011 IEEE Workshop on Robotic Intelligence In Informationally Structured Space.

[14]  Kazuya Yoshida,et al.  Development of a Networked Robotic System for Disaster Mitigation, -Navigation System based on 3D Geometry Acquisition , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Naoyuki Kubota,et al.  Tele-operation of robot partners through iPod touche , 2009, 2009 4th International Symposium on Computational Intelligence and Intelligent Informatics.