Context Free Grammars and Semantic Networks for Flexible Assembly Recognition

This contribution presents a syntactic approach to assembly recognition from vision. It emerged from a research project on advanced man-machine communication in an assembly scenario where computer scientists, linguists, and psychologist develop a machine that simulates human sensing and behavior and learns about its surroundings [19]. Instructed by a naive user the machine assembles toy models from parts of the baufix® construction-kit (see Fig. 1). As interaction takes place in a non standardized environment with arbitrarily arranged objects, flexible but robust techniques for object recognition are required. This is a problem of knowledge representation.

[1]  Aristides A. G. Requicha,et al.  Representations for assemblies , 1991 .

[2]  Heinrich Niemann,et al.  Semantic Networks for Understanding Scenes , 1997, Advances in Computer Vision and Machine Intelligence.

[3]  Arthur C. Sanderson,et al.  AND/OR graph representation of assembly plans , 1986, IEEE Trans. Robotics Autom..

[4]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[5]  守屋 悦朗,et al.  J.E.Hopcroft, J.D. Ullman 著, "Introduction to Automata Theory, Languages, and Computation", Addison-Wesley, A5変形版, X+418, \6,670, 1979 , 1980 .

[6]  Franz Kummert,et al.  Learning assembly sequence plans using functional models , 1999, Proceedings of the 1999 IEEE International Symposium on Assembly and Task Planning (ISATP'99) (Cat. No.99TH8470).

[7]  Avinash C. Kak,et al.  Integrating sensing, task planning, and execution for robotic assembly , 1996, IEEE Trans. Robotics Autom..

[8]  King-Sun Fu,et al.  Syntactic Pattern Recognition And Applications , 1968 .

[9]  Sukhan Lee,et al.  Computer-Aided Mechanical Assembly Planning , 1991 .

[10]  Katsushi Ikeuchi,et al.  Task-Oriented Generation of Visual Sensing Strategies in Assembly Tasks , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Franz Kummert,et al.  Soft Unification: Towards Robust Parsing of Spontanous Speech , 1999 .

[12]  Jerome Feder,et al.  Plex languages , 1971, Inf. Sci..

[13]  Keith D. Baker,et al.  Boundary models for assembly knowledge representation , 1996, IEEE Trans. Robotics Autom..

[14]  P. C. Stadzisz,et al.  An integrated approach for the design of multi-product assembly systems , 1998 .

[15]  Remko Scha,et al.  An Augmented Context Free Grammar for Discourse , 1988, COLING.

[16]  Patrick A. V. Hall,et al.  Equivalence between AND/OR graphs and context-free grammars , 1973, Commun. ACM.

[17]  Ipke Wachsmuth,et al.  Collaborative Research Centre “Situated Artificial Communicators” at the University of Bielefeld, Germany , 2004, Artificial Intelligence Review.

[18]  Ebrahim H. Mamdani,et al.  An Experiment in Linguistic Synthesis with a Fuzzy Logic Controller , 1999, Int. J. Hum. Comput. Stud..

[19]  Michael R. M. Jenkin,et al.  Computational principles of mobile robotics , 2000 .

[20]  Bonnie L. Webber,et al.  Structure and Ostension in the Interpretation of Discourse Deixis , 1991, ArXiv.

[21]  Samuel Pierre,et al.  An artificial intelligence approach for generating assembly sequences in CAD/CAM , 1996, Artif. Intell. Eng..

[22]  Katsushi Ikeuchi,et al.  Toward an assembly plan from observation. I. Task recognition with polyhedral objects , 1994, IEEE Trans. Robotics Autom..

[23]  Judea Pearl,et al.  Heuristics : intelligent search strategies for computer problem solving , 1984 .

[24]  Marc Hanheide.  Objektbezogene 3D-Erkennung automatisch generierter Konturmodelle in Intensitätsbildern , 2001 .

[25]  Franz Kummert,et al.  Hybrid object recognition in image sequences , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).