Visual feedback control of a vehicle based on MHE directly using partial marker information

Motion capture systems are widely used for measuring the position and the orientation of objects. It detects the markers attached to the objects, but they are sometimes lost sight by occlusion and dead angle of sensor. It becomes a problem that markers to determine the coordinates of the object are not measured. Thus, it is necessary to estimate state suppressing the influence of missing measurement. In this study, we propose a Moving Horizon Estimation for state estimation to tackle this issue. If any markers are not measured because of occlusion, MHE can estimate position of the robot uniquely because it optimizes the evaluation considering the error of available measurement and motion dynamics of the vehicle. In our previous study, we applied MHE for estimation of the position and heading angle of the vehicle robot with markers. In this paper, we will show the application of it to the visual feedback control for the robot using estimation value at real time. we will prove that MHE is effective because it can suppress the influence of occlusion and rapid change of input.

[1]  Stephen P. Boyd,et al.  CVXGEN: a code generator for embedded convex optimization , 2011, Optimization and Engineering.

[2]  Kazuma Sekiguchi,et al.  Vehicle state estimation by moving horizon estimation considering occlusion and outlier on 3D static cameras , 2015, 2015 IEEE Conference on Control Applications (CCA).

[3]  Yutaka Maeda,et al.  Visual feedback robot system via fuzzy control , 2010, Proceedings of SICE Annual Conference 2010.

[4]  Jan Swevers,et al.  Moving Horizon Estimation with a huber penalty function for robust pose estimation of tethered airplanes , 2013, 2013 American Control Conference.

[5]  Masato Ishikawa,et al.  Control strategies for mechanical systems with various constraints-control of non-holonomic systems , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[6]  Hassen Mekki,et al.  Path planning for 3D visual servoing: For a wheeled mobile robot , 2013, 2013 International Conference on Individual and Collective Behaviors in Robotics (ICBR).

[7]  James B. Rawlings,et al.  Critical Evaluation of Extended Kalman Filtering and Moving-Horizon Estimation , 2005 .

[9]  Kazuma Sekiguchi,et al.  EKF localization with variable covariance for LRS and odometry: Experimental verification , 2014, 2014 IEEE 13th International Workshop on Advanced Motion Control (AMC).

[10]  A. Aydin Alatan,et al.  Occlusion-aware 3D multiple object tracker with two cameras for visual surveillance , 2014, 2014 11th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[11]  Hassan Noura,et al.  Integration of a Vicon camera system for indoor flight of a Parrot AR Drone , 2015, 2015 10th International Symposium on Mechatronics and its Applications (ISMA).

[12]  Ashish D. Deshpande,et al.  Accurate, robust, and real-time estimation of finger pose with a motion capture system , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Kenichiro Nonaka,et al.  Model predictive parking control for nonholonomic vehicles using time-state control form , 2013, 2013 European Control Conference (ECC).

[14]  Kazuma Sekiguchi,et al.  Vehicle localization by sensor fusion of LRS measurement and odometry information based on moving horizon estimation , 2014, 2014 IEEE Conference on Control Applications (CCA).

[15]  Hiroyuki Kawai,et al.  Passivity-based Dynamic Visual Force Feedback Control for Fixed Camera Systems , 2008, 2008 IEEE International Symposium on Intelligent Control.