Sensor-based hybrid position/force control of a robot manipulator in an uncalibrated environment

The paper is devoted to the problem of controlling a robot manipulator for a class of constrained motions. The task under consideration is to control the manipulator, such that the end-effector follows a path on an unknown surface, with the aid of a single camera assumed to be uncalibrated with respect to the robot coordinates. To accomplish a task of this kind, we propose a new control strategy based on multisensor fusion. We assume that three different sensors-that is, encoders mounted at each joint of the robot with six degrees of freedom, a force-torque sensor mounted at the wrist of the manipulator, and a visual sensor with a single camera fixed to the ceiling of the workcell-are available. Also, we assume that the contact point between the tool grasped by the end-effector and the surface is frictionless. To describe the proposed algorithm that we have implemented, first we decouple the vector space of control variables into two subspaces. We use one for controlling the magnitude of the contact force on the surface and the other for controlling the constrained motion on the surface. This way, the control synthesis problem is decoupled and we are able to develop a new scheme that utilizes sensor fusion to handle uncalibrated parameters in the workcell, wherein the surface on which the task is to be performed is assumed to be visible, but has an a priori unknown position.

[1]  Joris De Schutter,et al.  Specification of force-controlled actions in the "task frame formalism"-a synthesis , 1996, IEEE Trans. Robotics Autom..

[2]  Peter Corke,et al.  VISUAL CONTROL OF ROBOT MANIPULATORS – A REVIEW , 1993 .

[3]  Tzyh Jong Tarn,et al.  Multisensor-based robotic manipulation in an uncalibrated manufacturing workcell , 1999 .

[4]  Hiroaki Ozaki,et al.  On the force feedback control of a manipulator with a compliant wrist force sensor , 1983 .

[5]  Songde Ma,et al.  A self-calibration technique for active vision systems , 1996, IEEE Trans. Robotics Autom..

[6]  Mansour Eslami,et al.  Robust adaptive controller designs for robot manipulator systems , 1987, IEEE J. Robotics Autom..

[7]  Tsuneo Yoshikawa,et al.  Dynamic hybrid position/force control of robot manipulators--Description of hand constraints and calculation of joint driving force , 1986, IEEE Journal on Robotics and Automation.

[8]  Pradeep K. Khosla,et al.  Force and vision resolvability for assimilating disparate sensory feedback , 1996, IEEE Trans. Robotics Autom..

[9]  A. Isidori,et al.  Nonlinear feedback in robot arm control , 1984, The 23rd IEEE Conference on Decision and Control.

[10]  Antti J. Koivo,et al.  Real-time vision feedback for servoing robotic manipulator with self-tuning controller , 1991, IEEE Trans. Syst. Man Cybern..

[11]  Sharon A. Stansfield,et al.  A Robotic Perceptual System Utilizing Passive Vision and Active Touch , 1988, Int. J. Robotics Res..

[12]  Jake K. Aggarwal,et al.  Experiments in Intensity Guided Range Sensing Recognition of Three-Dimensional Objects , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Tzyh Jong Tarn,et al.  Integration of real-time planning and control in an unstructured manufacturing workcell , 1998, Adv. Robotics.

[14]  Peter K. Allen,et al.  Integrating Vision and Touch for Object Recognition Tasks , 1988, Int. J. Robotics Res..

[15]  Gregory D. Hager,et al.  A modular system for robust positioning using feedback from stereo vision , 1997, IEEE Trans. Robotics Autom..

[16]  Anita M. Flynn,et al.  Redundant Sensors for Mobile Robot Navigation , 1985 .

[17]  Ren C. Luo,et al.  The issues and approaches of a robot multi-sensor integration , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[18]  Olivier Faugeras,et al.  Motion of an uncalibrated stereo rig: self-calibration and metric reconstruction , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[19]  John J. Craig,et al.  Hybrid position/force control of manipulators , 1981 .

[20]  Peter K. Allen,et al.  Alignment using an uncalibrated camera system , 1995, IEEE Trans. Robotics Autom..

[21]  D. L. Hall,et al.  Mathematical Techniques in Multisensor Data Fusion , 1992 .

[22]  William L. Wilson,et al.  VISUAL SERVO CONTROL OF ROBOTS USING KALMAN FILTER ESTIMATES OF ROBOT POSE RELATIVE TO WORK-PIECES , 1993 .

[23]  P. K. Khosla,et al.  Robotic Visual Servoing Around a Static Target: An Example of Controlled Active Vision , 1992, 1992 American Control Conference.

[24]  Hendrik Van Brussel,et al.  Robot assembly using active force feedback accommodation , 1979 .

[25]  Peter K. Allen,et al.  Real-time visual servoing , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[26]  Daniel E. Whitney,et al.  Force Feedback Control of Manipulator Fine Motions , 1977 .

[27]  Seth Hutchinson,et al.  Visual compliance: task-directed visual servo control , 1994, IEEE Trans. Robotics Autom..

[28]  C. S. George Lee,et al.  Weighted selection of image features for resolved rate visual feedback control , 1991, IEEE Trans. Robotics Autom..

[29]  J. Salisbury,et al.  Active stiffness control of a manipulator in cartesian coordinates , 1980, 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[30]  Hidenori Kimura,et al.  LQ OPTIMAL AND NONLINEAR APPROACHES TO VISUAL SERVOING , 1993 .

[31]  Di Xiao Multisensor-based robotic manipulation in uncalibrated environments , 1998 .

[32]  Peter K. Allen,et al.  Integration of vision and force sensors for grasping , 1996, 1996 IEEE/SICE/RSJ International Conference on Multisensor Fusion and Integration for Intelligent Systems (Cat. No.96TH8242).

[33]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation: Part I—Theory , 1985 .

[34]  Oussama Khatib,et al.  Motion and force control of robot manipulators , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[35]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[36]  Jake K. Aggarwal,et al.  Multiple Sensor Integration/Fusion Through Image Processing: A Review , 1986 .

[37]  Yoshihiko Nakamura,et al.  Advanced robotics - redundancy and optimization , 1990 .

[38]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[39]  Weiping Li,et al.  Adaptive strategies in constrained manipulation , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[40]  Matthew T. Mason,et al.  Compliance and Force Control for Computer Controlled Manipulators , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[41]  Takeo Kanade,et al.  Visual tracking of a moving target by a camera mounted on a robot: a combination of control and vision , 1993, IEEE Trans. Robotics Autom..

[42]  Lee E. Weiss,et al.  Dynamic sensor-based control of robots with visual feedback , 1987, IEEE Journal on Robotics and Automation.

[43]  Pradeep K. Khosla,et al.  Strategies for Increasing the Tracking Region of an Eye-in-Hand System by Singularity and Joint Limit Avoidance , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[44]  Ning Xi,et al.  Force regulation and contact transition control , 1996 .

[45]  Shigeyuki Sakane,et al.  Estimation of contact position between a grasped object and the environment based on sensor fusion of vision and force , 1996, 1996 IEEE/SICE/RSJ International Conference on Multisensor Fusion and Integration for Intelligent Systems (Cat. No.96TH8242).

[46]  Tsuneo Yoshikawa,et al.  Dynamic hybrid position/force control of robot manipulators-on-line estimation of unknown constraint , 1993, IEEE Trans. Robotics Autom..

[47]  N. Harris McClamroch,et al.  Singular systems of differential equations as dynamic models for constrained robot systems , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.