Fly-the-Camera Perspective: Control of a Remotely Operated Quadrotor UAV and Camera Unit

This Chapter presents a mission-centric approach to controlling the optical axis of a video camera mounted on a camera positioner and fixed to a quadrotor remotely operated vehicle. The approach considers that for video collection tasks a single operator should be able to operate the system by ”flying-the-camera”; that is, collect video data from the perspective that the operator is looking out of and is the pilot of the camera. This will allow the control of the quadrotor and the camera manipulator to be fused into single robot manipulator control problem where the camera is positioned using the four degree-of-freedom (DOF) quadrotor and the two DOF camera positioner to provide a full six DOF actuation of the camera view. Design of a closed-loop controller to implement this approach is demonstrated using a Lyapunov-type analysis. Computer simulation results are provided to demonstrate the suggested controller. Historically, the primary driver for UAV reconnaissance capabilities has been military applications; however, we appear to be at the juncture where the cost and capabilities of such systems has become attractive in civilian applications. The success of recent UAV systems has raised expectations for an increased rate of technology development in critical factors such as low-cost, reliable sensors, air-frame construction, more robust and lightweight material, higher energy-density battery technologies, and interfaces that require less operator training. One of the essential technologies is the camera positioner, which includes camera, camera base, and multi-axis servo platform. The potential for UAVs with camera positioners has been well established in many applications as diverse as fire fighting, emergency response, military and civilian surveillance, crop monitoring, and geographical registration. Many research and commercial groups have provided convincing demonstrations of the utility of UAVs in these applications. Most of the commercial systems are equipped with camera positioners as standard equipment; however, the use of the camera is not integrated with the control of the UAV. The typical structures of a camera positioner include pan-tilt, tilt-roll, or pan/tilt/roll revolute joints or multi-axis gimbals. When considering the actuator of the camera gimbal, rate-gyros or encoders are used to measure the orientations. If the system is small and lightweight, the actuator dynamics can be discounted or neglected in the control of the UAV. Heavier systems, relative to the UAV, may require that the interaction of the camera

[1]  Thor I. Fossen,et al.  Marine Control Systems Guidance, Navigation, and Control of Ships, Rigs and Underwater Vehicles , 2002 .

[2]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[3]  Eric N. Johnson,et al.  Control Architecture for a UAV-Mounted Pan/Tilt/Roll Camera Gimbal , 2005 .

[4]  D.M. Dawson,et al.  Vision Assisted Autonomous Path Following for Unmanned Aerial Vehicles , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[5]  M. Spong,et al.  Robot Modeling and Control , 2005 .

[6]  P.Y. Oh,et al.  Human-in-the-Loop Camera Control for a Mechatronic Broadcast Boom , 2007, IEEE/ASME Transactions on Mechatronics.

[7]  Darren M. Dawson,et al.  Control of a remotely operated quadrotor aerial vehicle and camera unit using a fly-the-camera perspective , 2007, 2007 46th IEEE Conference on Decision and Control.

[8]  R. Rysdyk,et al.  Flight path following guidance for unmanned air vehicles with pan-tilt camera for target observation , 2003, Digital Avionics Systems Conference, 2003. DASC '03. The 22nd.

[9]  D.M. Dawson,et al.  Velocity control for a quad-rotor uav fly-by-camera interface , 2007, Proceedings 2007 IEEE SoutheastCon.

[10]  S. Shankar Sastry,et al.  A vision system for landing an unmanned aerial vehicle , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[11]  Nancy J. Cooke Human Factors of Remotely Operated Vehicles , 2006 .

[12]  Robert E. Mahony,et al.  A decoupled image space approach to visual servo control of a robotic manipulator , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[13]  Ezio Malis Contributions a la modelisation et a la commande en asservissement visuel , 1998 .

[14]  Bernard D. Adelstein,et al.  Rotation and direction judgment from visual images head-slaved in two and three degrees-of-freedom , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[15]  Randal W. Beard,et al.  Target Acquisition, Localization, and Surveillance Using a Fixed-Wing Mini-UAV and Gimbaled Camera , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[16]  B. Ekstrand Equations of motion for a two-axes gimbal system , 2001 .