Biomimetic control of pan-tilt-zoom camera for visual tracking based-on an autonomous helicopter

A novel control strategy of pan-tilt-zoom camera is described. Because the active camera is mounted on a moving autonomous helicopter in visual tracking system, and the tracked object is moving at same time, and there exists the vibration influence of the helicopter, image stabilization becomes poor, and all pixels are running. Therefore, a biomimetic control strategy of on-board pan-tilt-zoom camera is presented. In this paper, the biomimetic oculomotor control model is obtained based on physiological neural path of eye movement control. In order to validate the functions of the biomimetic control model, simulation experiments were done under the same condition as the physiological experiments in physiological researches. Then the biomimetic controller of onboard pan-tilt-zoom camera is developed. The results of flight tracking experiments show that the biomimetic controller can compensate the deflection caused by the flight platform, and enhance the visual tracking system performance.

[1]  Gérard G. Medioni,et al.  Detecting and tracking moving objects for video surveillance , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[2]  D A Robinson,et al.  The use of control systems analysis in the neurophysiology of eye movements. , 1981, Annual review of neuroscience.

[3]  张伟,et al.  Neural mechanism of vision , 2002 .

[4]  K. C. Lin,et al.  Implementation of a real-time moving object tracking system using visual servoing , 2003, Robotica.

[5]  Zhenbang Gong,et al.  Real-time Vision-based Object Tracking from a Moving Platform in the Air , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Vincenzo Lippiello,et al.  Real-time visual tracking based on BSP-tree representations of object boundary , 2005, Robotica.

[7]  Gérard G. Medioni,et al.  Continuous tracking within and across camera streams , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[8]  Gaurav S. Sukhatme,et al.  Detection and Tracking of External Features in an Urban Environment Using an Autonomous Helicopter , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[9]  Isaac Cohen,et al.  Detection and Tracking of Objects in Airborne Video Imagery , 2003 .

[10]  Gérard G. Medioni,et al.  Detection and tracking of moving objects from a moving platform in presence of strong parallax , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[11]  D. Robinson,et al.  Loss of the neural integrator of the oculomotor system from brain stem lesions in monkey. , 1987, Journal of neurophysiology.

[12]  Zhenbang Gong,et al.  Modeling of the UAV On-board Pan-tilt Control System Based on Biomimetic Eye , 2006, 2006 International Conference on Mechatronics and Automation.

[13]  Sylvie Treuillet,et al.  A biprocessor-oriented vision-based target tracking system , 2002, IEEE Trans. Ind. Electron..

[14]  JangMyung Lee,et al.  Optimal Representative Blocks for the Efficient Tracking of a Moving Object , 2004, J. Field Robotics.