Feedforward-output tracking regulation control for human-in-the-loop camera systems

Platforms like gantries, booms, aircraft and submersibles are equipped with cameras. People teleoperate such platforms to capture desired views of a scene or a target. To avoid collisions with the environment and occluded views, such platforms are often equipped with redundant degrees-of-freedom. The operator must manually coordinate multiple degrees-of-freedom in order to get desired views. Tracking moving targets becomes especially tedious and often requires several highly skilled operators. Visual-servoing some degrees-of-freedom may reduce operator burden and improve tracking performance. This paper builds upon previous successes with human-in-the-loop visual-servoing by integrating the platform's dynamics with computer vision. A broadcast boom is modelled and both simulation and experimental tests contrasting trained and untrained camera operators are presented.

[1]  Harry G. Kwatny,et al.  Nonlinear Control and Analytical Mechanics: A Computational Approach , 2000 .

[2]  Paul Y. Oh,et al.  Designing visually servoed tracking to augment camera teleoperators , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Peter I. Corke,et al.  Dynamic effects in visual closed-loop systems , 1996, IEEE Trans. Robotics Autom..

[4]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[5]  Alberto Isidori,et al.  Nonlinear control systems: an introduction (2nd ed.) , 1989 .

[6]  Peter K. Allen,et al.  Visual servoing by partitioning degrees of freedom , 2001, IEEE Trans. Robotics Autom..

[7]  P. R. Kalata,et al.  /spl alpha/-/spl beta/ target tracking with track rate variations , 1997, Proceedings The Twenty-Ninth Southeastern Symposium on System Theory.

[8]  Paul Y. Oh,et al.  Feedforward control for human-in-the-loop camera systems , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[9]  A. Isidori Nonlinear Control Systems , 1985 .

[10]  Gilmer L. Blankenship,et al.  Symbolic construction of models for multibody dynamics , 1995, IEEE Trans. Robotics Autom..

[11]  H. G. Kwatny,et al.  Nonlinear Control and Analytical Mechanics: A Computational Approach , 2001 .