Distributed multiple view fusion for two-arm distance estimation

We propose an approach for estimating the distance of two moving robot arms based on fusion of multiple vision data. The images are fused by simple concatenation of all images followed by a projection of the high-dimensional visual input data into an appropriate low-dimensional subspace. We extended the well known principal component analysis to the so-called output relevant features and present a distributed online computation algorithm performing the projection in parallel. We show that complex sensor data can be efficiently compressed if the robot motions are constrained to a local scenario. The second component of our model is an adaptive B-spline neuro-fuzzy controller whose input space is the constructed subspace and whose output is the estimated distance. Our experimental setup is a two-arm robot system with four uncalibrated cameras. Experiments with a complex circular motion show that the method works even if no robust geometric features can be extracted from the sensor pattern.

[1]  Minoru Asada,et al.  Versatile visual servoing without knowledge of true Jacobian , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[2]  Jianwei Zhang,et al.  Situated neuro-fuzzy control for vision-based robot localisation , 1999, Robotics Auton. Syst..

[3]  C. L. Boddy,et al.  Whole-arm reactive collision avoidance control of kinematically redundant manipulators , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[4]  E. Oja Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[5]  Homayoun Seraji,et al.  Sensor-Based Collision Avoidance: Theory and Experiments , 1996 .

[6]  James S. Albus,et al.  New Approach to Manipulator Control: The Cerebellar Model Articulation Controller (CMAC)1 , 1975 .

[7]  Olac Fuentes,et al.  Experimental evaluation of uncalibrated visual servoing for precision manipulation , 1997, Proceedings of International Conference on Robotics and Automation.

[8]  Alois Knoll,et al.  Constructing fuzzy controllers with B‐spline models—Principles and applications , 1998 .

[9]  Michael Greenspan,et al.  Obstacle count independent real-time collision avoidance , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[10]  Harry Shum,et al.  Principal Component Analysis with Missing Data and Its Application to Polyhedral Object Modeling , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Hiroshi Murase,et al.  Learning, positioning, and tracking visual appearance , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[12]  Christian Scheering,et al.  Uncalibrated hand-eye coordination with a redundant camera system , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[13]  René Zapata,et al.  Collision avoidance for a two-arm robot by reflex actions: Simulations and experimentations , 1995, J. Intell. Robotic Syst..

[14]  R. G. Beaumont,et al.  Real-time collision avoidance in two-armed robotic systems , 1991 .

[15]  Vladimir J. Lumelsky,et al.  Real-time collision avoidance in teleoperated whole-sensitive robot arm manipulators , 1993, IEEE Trans. Syst. Man Cybern..