Segmentation via manipulation

A paradigm of iterative, interactive scene segmentation and simplification of random heaps of unknown objects via vision and manipulation is introduced. The scene simplification is based on the graph operations of vertex and edge removal. These operations are defined isomorphic to the pick and push manipulation actions. Sensors are used as graph generators and the manipulator is used as the decomposing mechanism of the graphs. The model is a nondeterministic finite-state Turing machine. A vision system, a manipulator, and force/torque and other sensory input are integrated into a robot work cell. Experiments conducted to test convergence and error recovery of four different strategies are discussed. It is found that under certain conditions the strategies can tolerate errors in the sensory data, recover from pathological states, and converge. >

[1]  J. Hartmanis,et al.  Algebraic Structure Theory Of Sequential Machines , 1966 .

[2]  Narsingh Deo,et al.  Graph Theory with Applications to Engineering and Computer Science , 1975, Networks.

[3]  N.R. Malik,et al.  Graph theory with applications to engineering and computer science , 1975, Proceedings of the IEEE.

[4]  Tomás Lozano-Pérez,et al.  Automatic Planning of Manipulator Transfer Movements , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[5]  Matthew Thomas Mason,et al.  Manipulator grasping and pushing operations , 1982 .

[6]  Matthew T. Mason,et al.  Mechanics and Planning of Manipulator Pushing Operations , 1986 .

[7]  Michael A. Arbib,et al.  Problem decomposition for assembly planning , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[8]  V. T. Rajan,et al.  Dynamics of a rigid body in frictional contact with rigid walls: Motion in two dimensions , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[9]  Leonard S. Haynes,et al.  Robotic assembly by constraints , 1986, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[10]  Bernard Roth,et al.  On the spatial motion of a rigid body with point contact , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[11]  Narendra Ahuja,et al.  EXTRACTING SURFACES FROM STEREO IMAGES: AN INTEGRATED APPROACH. , 1987 .

[12]  Norihiro Abe,et al.  Construction of a consulting system from structural description of a mechanical object , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[13]  Arthur C. Sanderson,et al.  Planning robotic manipulation strategies for sliding objects , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[14]  Ruzena Bajcsy,et al.  Perception via manipulation , 1988 .

[15]  Daphna Weinshall,et al.  The MIT vision machine , 1988 .

[16]  Dana H. Ballard,et al.  Eye Fixation And Early Vision: Kinetic Depth , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[17]  Ruzena Bajcsy,et al.  Machine Systems for Exploration and Manipulation: A Conceptual Framework and Method of Evaluation , 1989 .