Low-cost 3D scene reconstruction for response robots in real-time

In this paper we discuss several methods for the creation of 3D models that can provide additional information to robot operators in order to improve their situation awareness of the robot being teleoperated. We derive the 3D models from spatial data gathered from an inexpensive, readily available, video game sensor. In addition, the paper introduces a new method for feature extraction as part of image registration in feature-sparse environments that operates in real-time.

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  Yiannis Gatsoulis,et al.  Mobile Robotic Issues for Urban Search and Rescue , 2008 .

[3]  Kazuya Yasuhara,et al.  Damage from the Great East Japan Earthquake and Tsunami - A quick report , 2011 .

[4]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[6]  Jason S. Metcalfe,et al.  Human-robot interaction modeling and simulation of supervisory control and situational awareness during field experimentation with military manned and unmanned ground vehicles , 2010, Defense + Commercial Sensing.

[7]  Robin R. Murphy,et al.  25. Situation Awareness in the Control of Unmanned Ground Vehicles , 2006 .

[8]  Binoy Pinto,et al.  Speeded Up Robust Features , 2011 .

[9]  Tom Drummond,et al.  Fusing points and lines for high performance tracking , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[10]  Julie A. Adams,et al.  Self-Rappelling Robot System for Inspection and Reconnaissance in Search and Rescue Applications , 2009, Adv. Robotics.

[11]  Jean Scholtz,et al.  A field study of two techniques for situation awareness for robot navigation in urban search and rescue , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[12]  Robin R. Murphy,et al.  RSVP: An investigation of remote shared visual presence as common ground for human-robot teams , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[13]  Mark Fiala,et al.  Visual Odometry Using 3-Dimensional Video Input , 2011, 2011 Canadian Conference on Computer and Robot Vision.

[14]  R. Murphy,et al.  Up from the Rubble: Lessons Learned about HRI from Search and Rescue , 2005 .

[15]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[16]  Holly A. Yanco,et al.  "Where am I?" Acquiring situation awareness using a remote robot platform , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[17]  Alexander Ferworn,et al.  Initial experiments on 3D modeling of complex disaster environments using unmanned aerial vehicles , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[18]  Zhu Haibing,et al.  Research and application of a robot orientation sensor , 2003, IEEE International Conference on Robotics, Intelligent Systems and Signal Processing, 2003. Proceedings. 2003.

[19]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.