Artificial Cognition in Production Systems

Today's manufacturing and assembly systems have to be flexible to adapt quickly to an increasing number and variety of products, and changing market volumes. To manage these dynamics, several production concepts (e.g., flexible, reconfigurable, changeable or autonomous manufacturing and assembly systems) were proposed and partly realized in the past years. This paper presents the general principles of autonomy and the proposed concepts, methods and technologies to realize cognitive planning, cognitive control and cognitive operation of production systems. Starting with an introduction on the historical context of different paradigms of production (e.g., evolution of production and planning systems), different approaches for the design, planning, and operation of production systems are lined out and future trends towards fully autonomous components of an production system as well as autonomous parts and products are discussed. In flexible production systems with manual and automatic assembly tasks, human-robot cooperation is an opportunity for an ergonomic and economic manufacturing system especially for low lot sizes. The state-of-the-art and a cognitive approach in this area are outlined. Furthermore, introducing self-optimizing and self-learning control systems is a crucial factor for cognitive systems. This principles are demonstrated by a quality assurance and process control in laser welding that is used to perform improved quality monitoring. Finally, as the integration of human workers into the workflow of a production system is of the highest priority for an efficient production, worker guidance systems for manual assembly with environmentally and situationally dependent triggered paths on state-based graphs are described in this paper.

[1]  Y. Rong,et al.  Flexible Fixturing with Phase-Change Materials. Part 1. Experimental Study on Magnetorheological Fluids , 2000 .

[2]  Nobutada Fujii,et al.  Modeling Biological Manufacturing Systems with Bounded-Rational Agents , 2006 .

[3]  G. Stiny.  Introduction to Shape and Shape Grammars , 1980 .

[4]  Stefan Kohlbecher,et al.  Gaze-based interaction in various environments , 2008, VNBA '08.

[5]  Peihua Gu,et al.  Free-form surface inspection techniques state of the art review , 2004, Comput. Aided Des..

[6]  J. Ilmarinen.  AGING WORKERS , 2001, Occupational and environmental medicine.

[7]  Sara McMains,et al.  CyberCut: An Internet-based CAD/CAM System , 2001, J. Comput. Inf. Sci. Eng..

[8]  Z. M. Bi,et al.  Flexible fixture design and automation: Review, issues and future directions , 2001 .

[9]  Sebastian Friedrich Gottschalk,et al.  High Resolution Production Management , 2007 .

[10]  Christopher D. Wickens,et al.  Attention and Trust Biases in the Design of Augmented Reality Displays , 2000 .

[11]  Stefan Bussmann,et al.  Self-organizing manufacturing control: an industrial application of agent technology , 2000, Proceedings Fourth International Conference on MultiAgent Systems.

[12]  Sonja Stork,et al.  Optimizing human-machine interaction in manual assembly , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.

[13]  Jonathan Corney,et al.  The CAD/CAM Interface: A 25-Year Retrospective , 2005, J. Comput. Inf. Sci. Eng..

[14]  Gerhard Rigoll,et al.  Static and Dynamic Hand-Gesture Recognition for Augmented Reality Applications , 2007, HCI.

[15]  Hao Zeng,et al.  Application of artificial neural network in laser welding defect diagnosis , 2005 .

[16]  Paul Valckenaers,et al.  Holonic Manufacturing Execution Systems , 2005 .

[17]  Klaus Diepold,et al.  Real-time cognitive technical systems, a learning material processing system, social and future aspects , 2009, 2009 IEEE Workshop on Advanced Robotics and its Social Impacts.

[18]  Joshua D. Summers,et al.  An Ontology for Representation of Fixture Design Knowledge , 2008 .

[19]  Egon Ostrosi,et al.  Feature modeling using a grammar representation approach , 2005, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[20]  Eiji Morinaga,et al.  Production Scheduling System with Dynamic Lot Size in Case of Considering Set-up Time , 2008 .

[21]  Jami J. Shah,et al.  Parametric and Feature-Based CAD/CAM: Concepts, Techniques, and Applications , 1995 .

[22]  Randy C. Brost,et al.  A 3-D modular gripper design tool , 1999, IEEE Trans. Robotics Autom..

[23]  Kristina Shea,et al.  A Parallel Grammar for Simulation-Driven Mechanical Design Synthesis , 2005, DAC 2005.

[24]  Nobutada Fujii,et al.  Line-less Production System Using Self-Organization: A Case Study for BMS , 2001 .

[25]  Xiaonan Li,et al.  Discovering Dispatching Rules Using Data Mining , 2005, J. Sched..

[26]  Pingyu Jiang,et al.  RFID-based wireless manufacturing for walking-worker assembly islands with fixed-position layouts , 2007 .

[27]  Tanneguy Redarce,et al.  CAD-based range sensor placement for optimum 3D data acquisition , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[28]  Kristina Shea,et al.  Generative Design and CNC Fabrication Using Shape Grammars , 2008, DAC 2008.

[29]  Valerie L. Shalin,et al.  The roles of humans and computers in distributed planning for dynamic domains , 2005, Cognition, Technology & Work.

[30]  Michael Beetz,et al.  Implicit coordination in robotic teams using learned prediction models , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[31]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[32]  Bernd Scholz-Reiter,et al.  Autonomous Processes in Assembly Systems , 2007 .

[33]  Alain Bernard,et al.  Analysis and Validation of 3D Laser Sensor Scanning Process , 1999 .

[34]  I ScottKirkpatrick.  Optimization by Simulated Annealing: Quantitative Studies , 1984 .

[35]  F. Musharavati.  RECONFIGURABLE MANUFACTURING SYSTEMS , 2010 .

[36]  Stefan Kaierle.  Process Monitoring and Control of Laser Beam Welding Measuring Quantifiable Data for Improved Processing Results , 2008 .

[37]  Dinesh Manocha,et al.  Fast Proximity Queries with Swept Sphere Volumes , 1999 .

[38]  Kristina Shea,et al.  A Flexible Fixture and Reconfiguration Process for the Cognitive Machine Shop , 2009 .

[39]  Lihui Wang,et al.  STEP-NC and function blocks for interoperable manufacturing , 2006, IEEE Transactions on Automation Science and Engineering.

[40]  Sören Larsson.  An industrial robot as carrier of a laser profile scanner: motion control, data capturing and path planning , 2008 .

[41]  Michael F. Zäh,et al.  Towards the Cognitive Factory , 2007 .

[42]  Mathey Wiesbeck,et al.  A Model for Adaptively Generating Assembly Instructions Using State-based Graphs , 2008 .

[43]  Craig A. Knoblock,et al.  PDDL-the planning domain definition language , 1998 .

[44]  S. Kaierle,et al.  Identification and predictive control of laser beam welding using neural networks , 2003, 2003 European Control Conference (ECC).

[45]  Paolo Cignoni,et al.  RoboScan: an automatic system for accurate and unattended 3D scanning , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[46]  Gerald Weigert,et al.  Simulation Based Scheduling System in a Semiconductor Backend Facility , 2006, Proceedings of the 2006 Winter Simulation Conference.

[47]  Kristina Shea,et al.  An Application of Shape Grammars to Planning for CNC Machining , 2009, DAC 2009.

[48]  Kristina Shea,et al.  A Framework for a Cognitive Design-to-Fabrication System , 2008 .

[49]  Jami J. Shah,et al.  Machining algebra for mapping volumes to machining operations , 1996 .

[50]  Friedrich Dausinger,et al.  Spatially resolved on-line monitoring during laser beam welding of steel and aluminum , 2004 .

[51]  Sergio Cavalieri,et al.  Multi-agent systems in production planning and control: an overview , 2004 .

[52]  A. Senthil Kumar,et al.  An automated design and assembly of interference-free modular fixture setup , 2000, Comput. Aided Des..

[53]  Fengfeng Xi,et al.  Model-based scanning path generation for inspection , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[54]  A. Galip Ulsoy,et al.  Trends and perspectives in flexible and reconfigurable manufacturing systems , 2002, J. Intell. Manuf..

[55]  Thibault Bautze,et al.  Focal Shift Monitoring and Cognitive Closed-Loop Control by Analysis of Co-Axial Video Data , 2009 .

[56]  Michael Beetz,et al.  Optimized Execution of Action Chains Using Learned Performance Models of Abstract Actions , 2005, IJCAI.

[57]  Andrés García Higuera,et al.  RFID-enhanced multi-agent based control for a machining system , 2007 .

[58]  Friedrich M. Wahl,et al.  Automatic decomposition of planned assembly sequences into skill primitives , 2001, IEEE Trans. Robotics Autom..

[59]  Alois Knoll,et al.  Joint-action for humans and industrial robots for assembly tasks , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.

[60]  Stephen T. Newman,et al.  FUTURE ISSUES FOR CAD/CAM AND , 2003 .

[61]  F. Jovane,et al.  Present and future of flexible automation: Towards new paradigms , 2003 .

[62]  Kazuhiro Ohkura,et al.  Modelling of Biological Manufacturing Systems for Dynamic Reconfiguration , 1997 .

[63]  Gunther Reinhart,et al.  Knowledge-Based Information Processing in Manufacturing Cells - The Present and the Future , 1996, AISMC.

[64]  Fred A. Hamprecht,et al.  Weakly Supervised Learning of a Classifier for Unusual Event Detection , 2008, IEEE Transactions on Image Processing.

[65]  Sonja Stork,et al.  Kognitive Assistenzsysteme in der Manuellen Montage , 2007 .

[66]  Jean-Michel Hoc,et al.  Towards a cognitive approach to human-machine cooperation in dynamic situations , 2001, Int. J. Hum. Comput. Stud..

[67]  Xin Wang,et al.  On quality functions for grasp synthesis, fixture planning, and coordinated manipulation , 2004, IEEE Transactions on Automation Science and Engineering.

[68]  Peter Nyhuis,et al.  Changeable Manufacturing - Classification, Design and Operation , 2007 .

[69]  Patrick Charpentier,et al.  Reducing simulation models for scheduling manufacturing facilities , 2005, Eur. J. Oper. Res..

[70]  Sonja Stork,et al.  The Influence of Instruction Mode on Reaching Movements during Manual Assembly , 2008, USAB.

[71]  Yoram Koren,et al.  General RMS Characteristics. Comparison with Dedicated and Flexible Systems , 2006 .

[72]  Sonja Stork,et al.  Towards Optimal Worker Assistance: Investigating Cognitive Processes in Manual Assembly , 2008 .

[73]  Erik Hollnagel,et al.  Cognition, Technology & Work: An Introduction , 1999, Cognition, Technology & Work.

[74]  Ronald J. Brachman,et al.  Systems That Know What They're Doing , 2002, IEEE Intell. Syst..

[75]  L. L. Dopping-Hepenstal.  Head-up displays. The integrity of flight information , 1981 .

[76]  Gerd Hirzinger,et al.  Capturing robot workspace structure: representing robot capabilities , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[77]  Stephen T. Newman,et al.  Future Issues for CAD/CAM and Intelligent Manufacture , 2002 .

[78]  Nicholas R. Jennings,et al.  Intelligent agents: theory and practice , 1995, The Knowledge Engineering Review.

[79]  Joe Cecil,et al.  Computer-Aided Fixture Design – A Review and Future Trends , 2001 .

[80]  Leif Kobbelt,et al.  Extraction of feature lines on triangulated surfaces using morphological operators , 2000 .

[81]  Lionel M. Ni,et al.  An RFID-Based Distributed Control System for Mass Customization Manufacturing , 2004, ISPA.

[82]  J. Latombe,et al.  Adaptive dynamic collision checking for single and multiple articulated robots in complex environments , 2005, IEEE Transactions on Robotics.

[83]  Klaus Diepold,et al.  A cognitive approach for a robotic welding system learning how to weld from acoustic data , 2009, CIRA 2009.

[84]  Michael Andersson,et al.  A simulation based decision support approach for operational capacity planning in a customer order driven assembly line , 1998, 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274).

[85]  Robin G. Qiu,et al.  RFID-enabled automation in support of factory integration , 2007 .

[86]  Klaus Finkenzeller,et al.  Book Reviews: RFID Handbook: Fundamentals and Applications in Contactless Smart Cards and Identification, 2nd ed. , 2004, ACM Queue.

[87]  Seokbae Son,et al.  Automated laser scanning system for reverse engineering and inspection , 2002 .

[88]  Lawrence Sass,et al.  Design Production : Constructing Freeform Designs with Rapid Prototyping , 2005 .

[89]  N. Emery,et al.  The eyes have it: the neuroethology, function and evolution of social gaze , 2000, Neuroscience & Biobehavioral Reviews.

[90]  Leo Alting,et al.  Human Factors in the Management of Production , 2006 .

[91]  José F. Hurtado,et al.  A model for synthesis of the fixturing configuration in pin-array type flexible machining fixtures , 2002 .

[92]  Gunther Reinhart,et al.  Integrating Augmented Reality in the Assembly Domain - Fundamentals, Benefits and Applications , 2003 .

[93]  G. Reinhart,et al.  Identification of implicit strategies in production control , 2008, 2008 IEEE International Conference on Industrial Engineering and Engineering Management.

[94]  Ruth Jill Urbanic,et al.  Assessment of Manufacturing Operational Complexity , 2004 .

[95]  Xiangyang Zhu,et al.  Optimality Criteria for Fixture Layout Design: A Comparative Study , 2009, IEEE Transactions on Automation Science and Engineering.

[96]  Thomas R. Gruber,et al.  A translation approach to portable ontology specifications , 1993, Knowl. Acquis..

[97]  Gerhard Rigoll,et al.  A Multimodal Human-Robot-Interaction Scenario: Working Together with an Industrial Robot , 2009, HCI.

[98]  Dejan Pangercic,et al.  Integration of perception, global planning and local planning in the manufacturing domain , 2009, 2009 IEEE Conference on Emerging Technologies & Factory Automation.

[99]  Stefan Kaierle Dr.-Ing..  Process Monitoring and Control of Laser Beam Welding , 2008 .

[100]  Michael F. Zaeh,et al.  A multi-agent-supported, product-based production control , 2009, 2009 IEEE International Conference on Control and Automation.

[101]  Abe Zeid,et al.  Investigating the design and development of truly agile flexible fixtures based on electrorheological fluids , 2009 .

[102]  Liyanage C. De Silva,et al.  Multimodal Approach to Human-Face Detection and Tracking , 2008, IEEE Transactions on Industrial Electronics.

[103]  Satyandra K. Gupta,et al.  IMACS: A Case Study in Real-World Planning , 1998, IEEE Intell. Syst..

[104]  Shui-Shong Lu,et al.  Development of a novel coordinate transposing fixture system , 1997 .

[105]  Reiner Onken,et al.  COSA – A generic cognitive system architecture based on a cognitive model of human behavior , 2003, Cognition, Technology & Work.

[106]  A. Blug,et al.  Closed loop control of laser welding processes with cellular neural network (CNN) cameras , 2008 .

[107]  X. W. Xu *,et al.  STEP-compliant NC research: the search for intelligent CAD/CAPP/CAM/CNC integration , 2005 .

[108]  Nobutada Fujii,et al.  Reinforcement Learning Approaches to Biological Manufacturing Systems , 2000 .

[109]  Friedrich M. Wahl,et al.  High LAP: A High Level System for Generating, Representing, and Evaluating Assembly Sequences , 1997, Int. J. Artif. Intell. Tools.

[110]  Klaus Diepold,et al.  A cognitive system for autonomous robotic welding , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[111]  Damien Trentesaux,et al.  Product-based and resource-based heterarchical approaches for dynamic FMS scheduling , 2004, Comput. Ind. Eng..

[112]  Peter Schröder,et al.  Multiresolution signal processing for meshes , 1999, SIGGRAPH.

[113]  Jonathan Cagan,et al.  Capturing a rebel: modeling the Harley-Davidson brand through a motorcycle shape grammar , 2002 .

[114]  Peter B. Luh,et al.  Holonic planning and scheduling for a robotic assembly testbed , 1994, Proceedings of the Fourth International Conference on Computer Integrated Manufacturing and Automation Technology.

[115]  Andrew Kusiak,et al.  Data Mining in Manufacturing: A Review , 2006 .

[116]  Jonathan Cagan,et al.  A Blend of Different Tastes: The Language of Coffeemakers , 1998 .

[117]  G. Roth,et al.  View planning for automated three-dimensional object reconstruction and inspection , 2003, CSUR.

[118]  Christian Brecher,et al.  Intelligent operations control: architecture for seamless integration of scheduling and execution , 2008, Prod. Eng..

[119]  Hoda A. ElMaraghy,et al.  Computer-Aided Planning of Laser Scanning of Complex Geometries , 2003 .

[120]  Klaus Diepold,et al.  Multiple sensors and Artificial Neural Networks in a cognitive technical system for laser welding , 2009, 2009 International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP).

[121]  Kristina Shea,et al.  The cognitive factory , 2010, Adv. Eng. Informatics.

[122]  Michael F. Zäh,et al.  Safety Aspects in a Human-Robot Interaction Scenario: A Human Worker Is Co-operating with an Industrial Robot , 2009, FIRA.

[123]  H. Van Brussel,et al.  Planning and Scheduling of Assembly Systems , 1990 .

[124]  Braulio Jose Alvarez,et al.  Constraints Evaluation and Working Methodology for Laser Scanning of Free-Form Surfaces , 2006, 2006 IEEE Conference on Emerging Technologies and Factory Automation.

[125]  Michael Beetz,et al.  Cognitive Technical Systems - What Is the Role of Artificial Intelligence? , 2007, KI.

[126]  Maria Caridi,et al.  Multi-agent systems in production planning and control: An application to the scheduling of mixed-model assembly lines , 2000 .

[127]  Klaus Diepold,et al.  A cognitive approach to monitor and control focal shifts in laser beam welding applications , 2009, 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems.

[128]  S. Mirdamadi,et al.  Discrete Event Simulation-Based Real-Time Shop Floor Control , 2007 .

[129]  Michael F. Zäh,et al.  Systematic workplace and assembly redesign for aging workforces , 2007, Prod. Eng..

[130]  H. Bekkering,et al.  Joint action: bodies and minds moving together , 2006, Trends in Cognitive Sciences.

[131]  Joshua D. Summers,et al.  A review of computer-aided fixture design with respect to information support requirements , 2008 .

[132]  Robert Hooke,et al.  `` Direct Search'' Solution of Numerical and Statistical Problems , 1961, JACM.

[133]  Sanjay E. Sarma,et al.  Auto ID systems and intelligent manufacturing control , 2003 .

[134]  Manolis I. A. Lourakis,et al.  Real-Time Tracking of Multiple Skin-Colored Objects with a Possibly Moving Camera , 2004, ECCV.

[135]  Scott Kirkpatrick,et al.  Optimization by simulated annealing: Quantitative studies , 1984 .

[136]  Jonathan Cagan,et al.  On the use of shape grammars as expert systems for geometry-based engineering design , 2000, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[137]  Kristina Shea.  The Cognitive Factory , 2010 .

[138]  Jami J. Shah,et al.  A Discourse on Geometric Feature Recognition From CAD Models , 2001, J. Comput. Inf. Sci. Eng..

[139]  Kenneth N. Brown,et al.  Features, aka the semantics of a formal language of manufacturing , 1995 .

[140]  M. Matarić.  Behavior-based robotics as a tool for synthesis of artificial behavior and analysis of natural behavior , 1998, Trends in Cognitive Sciences.

[141]  Alois Knoll,et al.  Mutual Information-Based 3D Object Tracking , 2008, International Journal of Computer Vision.

[142]  Friedrich M. Wahl,et al.  Executing assembly tasks specified by manipulation primitive nets , 2005, Adv. Robotics.

[143]  László Monostori,et al.  Agent-based systems for manufacturing , 2006 .

[144]  S.N. Melkote,et al.  Modeling of the holding force in an electromagnetic chuck , 1999, 1999 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (Cat. No.99TH8399).