Innovative control of assembly systems and lines

Abstract The increasing demand for flexibility and reconfigurability of assembly lines generates new challenges for the control of these lines and their subsystems, such as robots, grippers, conveyors or automated guided vehicles. Also new requirements for their interaction between each other and the environment as well as with humans arise. On the other hand the rapid change of information and communication technology opens new potentials for innovative control. Due to the high degree of interconnection between controllers, actuators and sensors, the classical automation pyramid is replaced by networked structures with a higher degree of flexibility, but also higher complexity. This trend is supported by the ability to collect and process data within cloud environments, the rapid increase of computational power of decentralized and embedded controllers and the high potential of machine learning for automation. This keynote gives an overview of innovative approaches in ICT and robotics for flexible control and automation of assembly lines and systems.

[1]  Valeriy Vyatkin IEC 61499 as Enabler of Distributed and Intelligent Automation: State-of-the-Art Review , 2011, IEEE Transactions on Industrial Informatics.

[2]  Ralph Bruder,et al.  The European Assembly Worksheet , 2013 .

[3]  Hiroshi Fujii,et al.  Disassembly operation support system with motion monitoring of a human operator , 2001 .

[4]  Ken Goldberg,et al.  Cloud Robotics and Automation: A Survey of Related Work , 2013 .

[5]  Sotiris Makris,et al.  Vision System for Robotic Handling of Randomly Placed Objects , 2013 .

[6]  Sotiris Makris,et al.  Augmented reality system for operator support in human–robot collaborative assembly , 2016 .

[7]  Lihui Wang,et al.  Current status of reconfigurable assembly systems , 2007, Int. J. Manuf. Res..

[8]  Robert W. Brennan,et al.  Toward Real-Time Distributed Intelligent Control: A Survey of Research Themes and Applications , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[9]  Lihui Wang,et al.  Current status and advancement of cyber-physical systems in manufacturing , 2015 .

[10]  Lihui Wang,et al.  Embedding a process plan in function blocks for adaptive machining , 2010 .

[11]  George Chryssolouris,et al.  Augmented Reality for Human-Based Assembly: Using Product and Process Semantics , 2013, IFAC HMS.

[12]  Alexander Verl,et al.  Cooperation of human and machines in assembly lines , 2009 .

[13]  Xun Xu,et al.  From cloud computing to cloud manufacturing , 2012 .

[14]  Lihui Wang,et al.  Wise-ShopFloor: An Integrated Approach for Web-Based Collaborative Manufacturing , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[15]  Birgit Vogel-Heuser,et al.  Evolution of software in automated production systems: Challenges and research directions , 2015, J. Syst. Softw..

[16]  Sotiris Makris,et al.  Human–robot interaction review and challenges on task planning and programming , 2016, Int. J. Comput. Integr. Manuf..

[17]  Gunther Reinhart,et al.  Modular Configuration of an RFID-based Hybrid Control Architecture for a Situational Shop Floor Control , 2013 .

[18]  Xun Xu,et al.  Extended study of network capability for cloud based control systems , 2017 .

[19]  Bernd Scholz-Reiter,et al.  Autonomously controlled production systems—Influence of autonomous control level on logistic performance , 2009 .

[20]  Siddhartha S. Srinivasa,et al.  Human-robot shared workspace collaboration via hindsight optimization , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[21]  Danica Kragic,et al.  Dual arm manipulation - A survey , 2012, Robotics Auton. Syst..

[22]  Shen-Chou Yeh,et al.  Collaborative design for an assembly via the Internet , 2007 .

[23]  Soh-Khim Ong,et al.  Augmented assembly technologies based on 3D bare-hand interaction , 2011 .

[24]  Sergey Levine,et al.  Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection , 2016, Int. J. Robotics Res..

[25]  Jörg Krüger,et al.  Dual arm robot for flexible and cooperative assembly , 2011 .

[26]  M. Hagele,et al.  rob@work: Robot assistant in industrial environments , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[27]  Thomas Bauernhansl Automotive industry without conveyer belt and cycle – research campus ARENA2036 , 2015 .

[28]  Lee E. Weiss,et al.  Adaptive Visual Servo Control of Robots , 1983 .

[29]  Oussama Khatib,et al.  A unified approach for motion and force control of robot manipulators: The operational space formulation , 1987, IEEE J. Robotics Autom..

[30]  R. Bernhardt,et al.  Realistic robot simulation , 1995 .

[31]  Weiming Shen,et al.  Nrc Publications Archive (nparc) Archives Des Publications Du Cnrc (nparc) Distributed Device Networks with Security Constraints Distributed Device Networks with Security Constraints* Distributed Device Networks with Security Constraints , 2022 .

[32]  Jörg Krüger,et al.  Automated vision-based live ergonomics analysis in assembly operations , 2015 .

[33]  Sang Do Noh,et al.  An agent-based collaborative assembly process planning system , 2006 .

[34]  M. Jelinek,et al.  Manufacturing as a service business: CIM in the 21st century , 1990 .

[35]  Dazhong Wu,et al.  Cloud-based design and manufacturing: A new paradigm in digital manufacturing and design innovation , 2015, Comput. Aided Des..

[36]  Emanuele Carpanzano,et al.  Automated formal verification for flexible manufacturing systems , 2014, J. Intell. Manuf..

[37]  Yinong Chen,et al.  Internet of intelligent things and robot as a service , 2013, Simul. Model. Pract. Theory.

[38]  Paul Rodgers,et al.  WebCADET: facilitating distributed design support , 1998 .

[39]  Tao Zhang,et al.  Fog and IoT: An Overview of Research Opportunities , 2016, IEEE Internet of Things Journal.

[40]  Gunther Reinhart,et al.  Cyber-physical Robotics – Automated Analysis, Programming and Configuration of Robot Cells based on Cyber-physical-systems , 2014 .

[41]  Przemyslaw A. Lasota,et al.  Toward safe close-proximity human-robot interaction with standard industrial robots , 2014, 2014 IEEE International Conference on Automation Science and Engineering (CASE).

[42]  Alexander Verl,et al.  Communication Mechanisms for Cloud based Machine Controls , 2014 .

[43]  Weiming Shen,et al.  A Java 3d-enabled cyber workspace , 2002, CACM.

[44]  Gunther Reinhart,et al.  Integrating Augmented Reality in the Assembly Domain - Fundamentals, Benefits and Applications , 2003 .

[45]  Dragoljub Surdilovic,et al.  Compliance control with dual-arm humanoid robots: Design, planning and programming , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[46]  Lorenzo Molinari Tosatti,et al.  Trajectory-dependent safe distances in human-robot interaction , 2014, Proceedings of the 2014 IEEE Emerging Technology and Factory Automation (ETFA).

[47]  Dazhong Wu,et al.  Cloud manufacturing: Strategic vision and state-of-the-art☆ , 2013 .

[48]  Francesco Braghin,et al.  Impedance shaping controller for robotic applications involving interacting compliant environments and compliant robot bases , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[49]  Pedro M. Domingos A few useful things to know about machine learning , 2012, Commun. ACM.

[50]  Lihui Wang,et al.  Robotic assembly planning and control with enhanced adaptability through function blocks , 2015 .

[51]  Dragoljub Surdilovic,et al.  Robust Control of Interaction with Haptic Interfaces , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[52]  Neil A. Duffie,et al.  Dynamics of Real-Time Distributed Scheduling in Multiple-Machine Heterarchical Manufacturing Systems , 1998 .

[53]  Sotiris Makris,et al.  Dynamic job rotation for workload balancing in human based assembly systems , 2010 .

[54]  Gunther Reinhart,et al.  Current State Model for Easy Reconfiguration of Robot Systems and Offline-Programming-Environments , 2010, ISR/ROBOTIK.

[55]  Sotiris Makris,et al.  Intuitive dual arm robot programming for assembly operations , 2014 .

[56]  Emanuele Carpanzano,et al.  Reconfigurable Knowledge-based Control Solutions for Responsive Manufacturing Systems , 2011 .

[57]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation , 1984, 1984 American Control Conference.

[58]  Alexander Verl,et al.  Grasping devices and methods in automated production processes , 2014 .

[59]  Sotiris Makris,et al.  Augmented Reality (AR) Applications for Supporting Human-robot Interactive Cooperation , 2016 .

[60]  Neville Hogan,et al.  An analysis of contact instability in terms of passive physical equivalents , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[61]  Jörg Krüger,et al.  Control of robots and machine tools with an extended factory cloud , 2015, 2015 IEEE World Conference on Factory Communication Systems (WFCS).

[62]  Tamir Hegazy,et al.  Industrial Automation as a Cloud Service , 2015, IEEE Transactions on Parallel and Distributed Systems.

[63]  Fei Tao,et al.  Cloud manufacturing: a computing and service-oriented manufacturing model , 2011 .

[64]  Dragoljub Surdilovic,et al.  Flexible Assembly Systems through Workplace-Sharing and Time- Sharing Human-Machine Cooperation (PISA) , 2010, ISR/ROBOTIK.

[65]  Sebastian Biallas,et al.  Cloud-Based Control: A Multi-tenant, Horizontally Scalable Soft-PLC , 2015, 2015 IEEE 8th International Conference on Cloud Computing.

[66]  Soundar R. T. Kumara,et al.  Cyber-physical systems in manufacturing , 2016 .

[67]  Alois Zoitl,et al.  Towards flexible and adaptive productions systems based on virtual cloud-based control , 2014, Proceedings of the 2014 IEEE Emerging Technology and Factory Automation (ETFA).

[68]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[69]  Sotiris Makris,et al.  The new assembly system paradigm , 2015, Int. J. Comput. Integr. Manuf..

[70]  Thilo Sauter,et al.  The Three Generations of Field-Level Networks—Evolution and Compatibility Issues , 2010, IEEE Transactions on Industrial Electronics.

[71]  Helmut Bley,et al.  Variant-oriented Assembly Planning , 2006 .

[72]  Lihui Wang,et al.  Machine availability monitoring and machining process planning towards Cloud manufacturing , 2013 .

[73]  Jun Ota,et al.  Agile Assembly System by “Plug and Produce” , 2000 .

[74]  Jörg Krüger,et al.  ErgoAssist: An assistance system to maintain ergonomie guidelines at workplaces , 2014, Proceedings of the 2014 IEEE Emerging Technology and Factory Automation (ETFA).

[75]  A. Valente,et al.  Development of multi-level adaptive control and scheduling solutions for shop-floor automation in reconfigurable manufacturing systems , 2011 .

[76]  Sotiris Makris,et al.  ROBO-PARTNER: Seamless Human-Robot Cooperation for Intelligent, Flexible and Safe Operations in the Assembly Factories of the Future☆ , 2014 .

[77]  Jeremy A. Marvel,et al.  Performance Metrics of Speed and Separation Monitoring in Shared Workspaces , 2013, IEEE Transactions on Automation Science and Engineering.

[78]  Jörg Krüger,et al.  Robust control of force-coupled human-robot-interaction in assembly processes , 2008 .

[79]  Yongkui Liu,et al.  Manufacturing Service Management in Cloud Manufacturing: Overview and Future Research Directions , 2015 .

[80]  Thomas Bauernhansl,et al.  Changeable Assembly Systems Through Flexibly Linked Process Modules , 2016 .

[81]  Honglak Lee,et al.  Deep learning for detecting robotic grasps , 2013, Int. J. Robotics Res..

[82]  George Chryssolouris,et al.  Autonomous Production Systems Using Open Architectures and Mobile Robotic Structures , 2015 .

[83]  Amedeo Cesta,et al.  Intelligent dynamic part routing policies in Plug&Produce Reconfigurable Transportation Systems , 2014 .

[84]  Valeriy Vyatkin,et al.  IEC 61499 distributed control enhanced with cloud-based web-services , 2015, 2015 IEEE 10th Conference on Industrial Electronics and Applications (ICIEA).

[85]  Jörg Krüger,et al.  Markerless gesture-based motion control and programming of industrial robots , 2011, ETFA2011.

[86]  Henning Trsek,et al.  Cloud computing for industrial automation systems — A comprehensive overview , 2013, 2013 IEEE 18th Conference on Emerging Technologies & Factory Automation (ETFA).

[87]  Hongyu Pei Breivold,et al.  Internet of Things for Industrial Automation -- Challenges and Technical Solutions , 2015, 2015 IEEE International Conference on Data Science and Data Intensive Systems.

[88]  Fengjie Tian,et al.  Modeling and control of robotic automatic polishing for curved surfaces , 2016 .

[89]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[90]  Krzysztof Jemielniak,et al.  Advanced monitoring of machining operations , 2010 .

[91]  Marco Santochi,et al.  Sensor technology in assembly systems , 1998 .

[92]  Timo Malm,et al.  Meeting New Challenges and Possibilities with Modern Robot Safety Technologies , 2014 .

[93]  Lihui Wang,et al.  Function block design for adaptive execution control of job shop machining operations , 2009 .

[94]  H. Van Brussel,et al.  Planning and Scheduling of Assembly Systems , 1990 .

[95]  Jörg Krüger,et al.  Robot control as a service — Towards cloud-based motion planning and control for industrial robots , 2015, 2015 10th International Workshop on Robot Motion and Control (RoMoCo).

[96]  Lihui Wang,et al.  Design of adaptive function blocks for dynamic assembly planning and control , 2008 .

[97]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[98]  Valeriy Vyatkin,et al.  Redesign Distributed PLC Control Systems Using IEC 61499 Function Blocks , 2012, IEEE Transactions on Automation Science and Engineering.

[99]  Thomas Bauernhansl,et al.  Virtual Fort Knox Federative, Secure and Cloud-based Platform for Manufacturing , 2013 .

[100]  Alain Bernard,et al.  CAD model based virtual assembly simulation, planning and training , 2013 .

[101]  Robert W. Brennan,et al.  Realizing holonic control with function blocks , 2001, Integr. Comput. Aided Eng..

[102]  Britta Geissler,et al.  Measuring mechanical pain: The refinement and standardization of pressure pain threshold measurements , 2015, Behavior research methods.

[103]  Gunther Reinhart,et al.  Approach for an RFID-based situational shop floor control , 2012, 2012 IEEE International Conference on Industrial Engineering and Engineering Management.

[104]  Robert X. Gao,et al.  Cloud-enabled prognosis for manufacturing , 2015 .

[105]  Stefan Wesner,et al.  An Approach for a Cloud-based Machine Tool Control , 2013 .

[106]  Hans Kurt Tönshoff,et al.  Process Monitoring in Grinding , 2002 .

[107]  P. Mell,et al.  The NIST Definition of Cloud Computing , 2011 .

[108]  Lihui Wang,et al.  Journal of Computing and Information Science in Engineering Application Briefs Wise-shopfloor: a Web-based and Sensor-driven E-shop Floor* , 2004 .

[109]  Peter Nyhuis,et al.  Changeable Manufacturing - Classification, Design and Operation , 2007 .

[110]  Emanuele Carpanzano,et al.  Object-Oriented Models for Advanced Automation Engineering , 1998 .

[111]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[112]  Lihui Wang,et al.  A review of function blocks for process planning and control of manufacturing equipment , 2012 .

[113]  M. Otter,et al.  Spatial alignment of joining partners without fixtures, based on component-inherent markings , 2013 .

[114]  Bernd Scholz-Reiter,et al.  Dynamic flexible flow shop problems—Scheduling heuristics vs. autonomous control , 2010 .

[115]  Bernd Scholz-Reiter,et al.  Autonomous Processes in Assembly Systems , 2007 .

[116]  Lihui Wang,et al.  Remote robotic assembly guided by 3D models linking to a real robot , 2014 .

[117]  László Monostori,et al.  Machine Learning Approaches to Manufacturing , 1996 .

[118]  Chai Xu-dong,et al.  Cloud manufacturing:a new service-oriented networked manufacturing model , 2010 .

[119]  Lihui Wang,et al.  Assembly process planning and its future in collaborative manufacturing: a review , 2009 .

[120]  Axel Vick,et al.  Distributed real-time control service framework for human-robot interaction applications , 2016, 2016 IEEE 21st International Conference on Emerging Technologies and Factory Automation (ETFA).

[121]  Birgit Vogel-Heuser,et al.  Global Information Architecture for Industrial Automation , 2013 .

[122]  Lihui Wang,et al.  A sensor-driven 3D model-based approach to remote real-time monitoring , 2011 .

[123]  Peter Palensky,et al.  Communication and Computation in Buildings: A Short Introduction and Overview , 2010, IEEE Transactions on Industrial Electronics.

[124]  Gerald J. Agin Computer Vision Systems for Industrial Inspection and Assembly , 1980, Computer.

[125]  Bernd Scholz-Reiter,et al.  Autonomous Control of a Shop Floor Based on Bee's Foraging Behaviour , 2007, LDIC.

[126]  Emanuele Carpanzano,et al.  Distributed Intelligent Automation Solutions for Self-adaptive Manufacturing Plants , 2010, BASYS.

[127]  Sotiris Makris,et al.  ROS Based Coordination of Human Robot Cooperative Assembly Tasks-An Industrial Case Study☆ , 2015 .

[128]  Gunther Reinhart,et al.  Automatisierte Konfiguration und Selbstauskunft von Industrierobotern – Intelligente Vernetzung mittels ROS und OPC UA , 2016 .

[129]  Nam P. Suh,et al.  principles in design , 1990 .

[130]  Stephen P. Buerger,et al.  Relaxing Passivity for Human-Robot Interaction , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[131]  Sotiris Makris,et al.  Assembly support using AR technology based on automatic sequence generation , 2013 .

[132]  Miomir Vukobratović,et al.  Control of Robotic Systems in Contact Tasks , 2001 .

[133]  Emanuele Carpanzano,et al.  A methodology for static and dynamic scheduling of automation tasks in reconfigurable production systems , 2012 .

[134]  Jörg Krüger,et al.  The Working Posture Controller: Automated Adaptation of the Work Piece Pose to Enable a Natural Working Posture , 2016 .

[135]  Kristian Sandström,et al.  Evaluating industrial applicability of virtualization on a distributed multicore platform , 2014, Proceedings of the 2014 IEEE Emerging Technology and Factory Automation (ETFA).

[136]  Jan Guhl,et al.  Model predictive control as a service — Concept and architecture for use in cloud-based robot control , 2016, 2016 21st International Conference on Methods and Models in Automation and Robotics (MMAR).

[137]  Masahiko Mori,et al.  Development of remote monitoring and maintenance system for machine tools , 2008 .

[138]  Emanuele Carpanzano,et al.  A structured methodology for the design and implementation of control and supervision systems for robotic applications , 2002, IEEE Trans. Control. Syst. Technol..

[139]  Dazhong Wu,et al.  Cloud Manufacturing: Drivers, Current Status, and Future Trends , 2013 .

[140]  Gerhard P Hancke,et al.  Introduction to Industrial Control Networks , 2013, IEEE Communications Surveys & Tutorials.

[141]  F. Jovane,et al.  Reconfigurable Manufacturing Systems , 1999 .

[142]  Carlos E. Cugnasca,et al.  Implementation of a Control Loop Experiment in a Network-Based Control System With LonWorks Technology and IP Networks , 2010, IEEE Transactions on Industrial Electronics.

[143]  Gunther Reinhart,et al.  Online-simulation of fluidic processes in early design of plant development using SPH , 2016 .

[144]  Nam P. Suh,et al.  Axiomatic Design: Advances and Applications , 2001 .

[145]  A. H. Redford,et al.  Generic flexible assembly system design , 2002 .

[146]  Björn Matthias,et al.  Safety of Industrial Robots: From Conventional to Collaborative Applications , 2012, ROBOTIK.

[147]  Lihui Wang,et al.  A cloud-based approach for WEEE remanufacturing , 2014 .

[148]  Gunther Reinhart,et al.  CAD-Based Automated Assembly Planning for Variable Products in Modular Production Systems☆ , 2016 .

[149]  Ramakrishnan Rajamony,et al.  An updated performance comparison of virtual machines and Linux containers , 2015, 2015 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS).

[150]  Lida Xu,et al.  AutoAssem: An Automated Assembly Planning System for Complex Products , 2012, IEEE Transactions on Industrial Informatics.

[151]  Adriano Valenzano,et al.  System-level performance of an automation solution based on industry standards , 2014, Proceedings of the 2014 IEEE Emerging Technology and Factory Automation (ETFA).

[152]  I. Rudas,et al.  The rising prospects of cloud robotic applications , 2013, 2013 IEEE 9th International Conference on Computational Cybernetics (ICCC).

[153]  Gunther Reinhart,et al.  Unified Plug&Produce architecture for automatic integration of field devices in industrial environments , 2015, 2015 IEEE International Conference on Industrial Technology (ICIT).

[154]  F. Jovane,et al.  Advanced automation solutions for future adaptive factories , 2007 .

[155]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[156]  Lihui Wang,et al.  Ubiquitous manufacturing system based on Cloud , 2017 .

[157]  Sotiris Makris,et al.  Robotized Assembly Process Using Dual Arm Robot , 2014 .