Modeling, planning, and scheduling of shop-floor assembly process with dynamic cyber-physical interactions: a case study for CPS-based smart industrial robot production

In recent years, the applications of industrial robots are expanding rapidly due to Industry 4.0 oriented evolutions, ranging from automobile industry to almost all manufacturing domains. As demands with rapid product iterations become increasingly fluctuant and customized, the assembly process of industrial robots faces new challenges including dynamic reorganization and reconfiguration, ubiquitous sensing, and communication with time constraints, etc. This paper studies the industrial robot assembly process modeling, planning, and scheduling based on real-time data acquisition and fusion under the framework of advanced shop-floor communication and computing technologies such as wireless sensor, actuator network, and edge computing. Taking the assembly of industrial robots as the specific object, the multi-agent model of industrial robot assemble process is established. Then, the encapsulation, communication, and interaction of agents with real-time data acquisition and fusion are studied. Based on multi-agent reinforcement learning approach, an intelligent planning and scheduling algorithm for industrial robot assembly is proposed, and a simulation case is presented to demonstrate the proposed model and algorithm.

[1]  Helmut Zaiser,et al.  Competences for Cyber-physical Systems in Manufacturing – First Findings and Scenarios , 2014 .

[2]  Jay Lee,et al.  A Cyber-Physical Systems architecture for Industry 4.0-based manufacturing systems , 2015 .

[3]  Ryszard Kowalczyk,et al.  Dynamic analysis of multiagent {\it Q}-learning with {\&}epsilon;-greedy exploration , 2009, ICML 2009.

[4]  Jay Lee,et al.  Smart Agents in Industrial Cyber–Physical Systems , 2016, Proceedings of the IEEE.

[5]  Mahadev Satyanarayanan,et al.  The Emergence of Edge Computing , 2017, Computer.

[6]  Jay Lee,et al.  Cyber-physical Systems Architecture for Self-Aware Machines in Industry 4.0 Environment , 2015 .

[7]  Fei Lu,et al.  The ZigBee Based Wireless Sensor and Actor Network in Intelligent Space Oriented to Home Service Robot , 2012 .

[8]  Remzi Seker,et al.  Big Data and virtualization for manufacturing cyber-physical systems: A survey of the current status and future outlook , 2016, Comput. Ind..

[9]  Carsten Wittenberg,et al.  Human-CPS Interaction - requirements and human-machine interaction methods for the Industry 4.0 , 2016 .

[10]  Soundar R. T. Kumara,et al.  Cyber-physical systems in manufacturing , 2016 .

[11]  Ali Vatankhah Barenji,et al.  Flexible testing platform for employment of RFID-enabled multi-agent system on flexible assembly line , 2016, Adv. Eng. Softw..

[12]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[13]  Thomas Gabel,et al.  Multi-agent reinforcement learning approaches for distributed job shop scheduling problems , 2009 .

[14]  Stefano Giordani,et al.  A distributed multi-agent production planning and scheduling framework for mobile robots , 2013, Comput. Ind. Eng..

[15]  Manoj Kumar Tiwari,et al.  Integration of process planning and scheduling using mobile-agent based approach in a networked manufacturing environment , 2016, Comput. Ind. Eng..

[16]  Bogdan-Constantin Pirvu,et al.  Engineering insights from an anthropocentric cyber-physical system: A case study for an assembly station , 2016 .

[17]  David Z. Zhang,et al.  Agent-based hierarchical production planning and scheduling in make-to-order manufacturing system , 2014 .

[18]  Khaled Ghédira,et al.  Simultaneous scheduling of machines and transport robots in flexible job shop environment using hybrid metaheuristics based on clustered holonic multiagent model , 2016, Comput. Ind. Eng..

[19]  Daqiang Zhang,et al.  Towards smart factory for industry 4.0: a self-organized multi-agent system with big data based feedback and coordination , 2016, Comput. Networks.

[20]  László Monostori,et al.  ScienceDirect Variety Management in Manufacturing . Proceedings of the 47 th CIRP Conference on Manufacturing Systems Cyber-physical production systems : Roots , expectations and R & D challenges , 2014 .

[21]  Ibrahim Kucukkoc,et al.  Mixed-model parallel two-sided assembly line balancing problem: A flexible agent-based ant colony optimization approach , 2016, Comput. Ind. Eng..

[22]  Adam Ziebinski,et al.  Agent-based manufacturing execution systems for short-series production scheduling , 2016, Comput. Ind..

[23]  Geoffrey C. Fox,et al.  Effective real-time scheduling algorithm for cyber physical systems society , 2014, Future Gener. Comput. Syst..

[24]  Gunther Reinhart,et al.  Cyber-Physical-Robotics – Modelling of modular robot cells for automated planning and execution of assembly tasks , 2016 .

[25]  Vernon K. Bumgardner,et al.  Contributions to Edge Computing , 2017 .

[26]  Weiming Shen,et al.  Applications of agent-based systems in intelligent manufacturing: An updated review , 2006, Adv. Eng. Informatics.

[27]  Florian Niebling,et al.  Modelling complex and flexible processes for smart cyber-physical environments , 2013, J. Comput. Sci..