Omnidirectional vision for an autonomous helicopter

We present the design and implementation of an omnidirectional vision system used for sideways-looking sensing on an autonomous helicopter. To demonstrate the capabilities of the system, a visual servoing task was designed which required the helicopter to locate and move towards the centroid of a number of visual targets. Results are presented showing that the task was successfully completed by a Pioneer ground robot equipped with the same omnidirectional vision system, and preliminary test flight results show that the system can generate appropriate control commands for the helicopter.

[1]  Gaurav S. Sukhatme,et al.  Combined optic-flow and stereo-based navigation of urban canyons for a UAV , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Gaurav S. Sukhatme,et al.  Vision-based autonomous landing of an unmanned aerial vehicle , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[3]  J. Gaspar,et al.  Omni-directional vision for robot navigation , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[4]  L. Matthies,et al.  A Compact and Low-Power Two-Axis Scanning Laser Rangefinder for Mobile Robots , 2001 .

[5]  Takeo Kanade,et al.  Advances in Cooperative Multi-Sensor Video Surveillance , 1999 .

[6]  Stefan Hrabar.  Design and control of an animatronic Aardvark , 2002 .

[7]  José Santos-Victor,et al.  Vision-based navigation and environmental representations with an omnidirectional camera , 2000, IEEE Trans. Robotics Autom..

[8]  Omead Amidi,et al.  3-D Site Mapping with the CMU Autonomous Helicopter , 1998 .

[9]  Gregory D. Hager,et al.  Efficient Region Tracking With Parametric Models of Geometry and Illumination , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Terrance E. Boult,et al.  Frame-rate omnidirectional surveillance and tracking of camouflaged and occluded targets , 1999, Proceedings Second IEEE Workshop on Visual Surveillance (VS'99) (Cat. No.98-89223).

[11]  Gaurav S. Sukhatme,et al.  Autonomous deployment and repair of a sensor network using an unmanned aerial vehicle , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[12]  Yasushi Yagi,et al.  Omnidirectional Sensing and Its Applications , 1999 .

[13]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[14]  Thad Starner,et al.  Finding location using omnidirectional video on a wearable computing platform , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[15]  Gaurav S. Sukhatme,et al.  A comparison of two camera configurations for optic-flow based navigation of a UAV through urban canyons , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[16]  Richard Szeliski,et al.  3-D Scene Data Recovery Using Omnidirectional Multibaseline Stereo , 2004, International Journal of Computer Vision.

[17]  Gaurav S. Sukhatme,et al.  Towards vision-based safe landing for an autonomous helicopter , 2002, Robotics Auton. Syst..

[18]  Mohan M. Trivedi,et al.  N-Ocular stereo for real-time human tracking , 2001 .

[19]  Gaurav S. Sukhatme,et al.  Most valuable player: a robot device server for distributed control , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[20]  Gaurav S. Sukhatme,et al.  Deployment and Connectivity Repair of a Sensor Net with a Flying Robot , 2004, ISER.

[21]  Ioannis Pitas,et al.  Digital Image Processing Algorithms , 1993 .

[22]  S. Shankar Sastry,et al.  A vision system for landing an unmanned aerial vehicle , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[23]  Shree K. Nayar,et al.  A theory of catadioptric image formation , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[24]  Martial Hebert,et al.  Omni-directional visual servoing for human-robot interaction , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[25]  Ben J. A. Kröse,et al.  3D scene reconstruction from cylindrical panoramic images , 2002, Robotics Auton. Syst..