Requirements for the benchmarking of decentralized manufacturing control systems

The research community of manufacturing control systems has a high demand for reference systems to evaluate and compare their algorithms. Most of the reference systems used in scientific works are not fully described in publications or even undefined, making valid comparisons of different algorithms impossible. In this article, we evaluate the state-of-the-art in reference systems and derive requirements for benchmarking such systems to increase comparability. Based on these requirements, we define three Complexity Dimensions: operational scenario, plant scenario, and transport system scenario. We utilize these Complexity Dimensions to generate a set of 36 scenarios to be used in reference systems for making them more suitable for comparison and evaluation of manufacturing control algorithms.

[1]  Robert J. Wittrock,et al.  Scheduling parallel machines with major and minor setup times , 1990 .

[2]  Stefan Bussmann,et al.  Self-organization in manufacturing operations , 2007, CACM.

[3]  Marco Macchi,et al.  A benchmark framework for manufacturing control , 1999 .

[4]  Robert W. Brennan,et al.  Metrics for evaluating distributed manufacturing control systems , 2003, Comput. Ind..

[5]  R. W. Brennan,et al.  Evaluating the relative performance of alternative control architectures for manufacturing , 1998, Proceedings of the 1998 IEEE International Symposium on Intelligent Control (ISIC) held jointly with IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA) Intell.

[6]  Heinz Wörn,et al.  Benchmarking of Multiagent Systems in a Production Planning and Control Environment , 2006, Multiagent Engineering.

[7]  Neil A. Duffie,et al.  Nonhierarchical control of manufacturing systems , 1986 .

[8]  Robert W. Brennan,et al.  A simulation testbed for comparing the performance of alternative control architectures , 1997, WSC '97.

[9]  Peter C. Lockemann,et al.  Benchmarking and robust multi-agent-based production planning and control , 2003 .

[10]  Hendrik Van Brussel,et al.  A Benchmarking Service for the Manufacturing Control Research Community , 2004 .

[11]  Marco Macchi,et al.  A Benchmarking Service for the evaluation and comparison of scheduling techniques , 2007, Comput. Ind..

[12]  Luc Bongaerts,et al.  Integration of scheduling and control in holonic manufacturing systems , 1998 .

[13]  Alexander Fay,et al.  Event-based and State-Automata-based Modelling of FMS , 2010, Simul. Notes Eur..

[14]  Paulo Leitao,et al.  Modelling and simulating self-organizing agent-based manufacturing systems , 2010, IECON 2010 - 36th Annual Conference on IEEE Industrial Electronics Society.

[15]  Marek Obitko,et al.  Semantic technologies: latest advances in agent-based manufacturing control systems , 2011 .

[16]  Marco Macchi,et al.  Development of a Reference Architecture for Benchmarking Service of Manufacturing Systems , 2003 .

[17]  Iman Badr Agent-based Dynamic Scheduling for Flexible Manufacturing Systems , 2011 .

[18]  Armando W. Colombo,et al.  Energy aware knowledge extraction from Petri nets supporting decision-making in service-oriented automation , 2010, 2010 IEEE International Symposium on Industrial Electronics.

[19]  Paulo Leitão,et al.  An agile and adaptive holonic architecture for manufacturing control , 2004 .

[20]  Martyn Fletcher,et al.  Evaluating a Holonic Packing Cell , 2003, HoloMAS.

[21]  Paulo Leitão,et al.  Implementation of a Holonic Control System in a Flexible Manufacturing System , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[22]  Paulo Leitão,et al.  Agent-based distributed manufacturing control: A state-of-the-art survey , 2009, Eng. Appl. Artif. Intell..

[23]  Pavel Vrba MAST: manufacturing agent simulation tool , 2003, EFTA 2003. 2003 IEEE Conference on Emerging Technologies and Factory Automation. Proceedings (Cat. No.03TH8696).

[24]  Robert W. Brennan,et al.  Evaluating the performance of reactive control architectures for manufacturing production control , 2001, Comput. Ind..