Situational Awareness for Manufacturing Applications

Collaboration between human workers and robotic assistants is seen as one way to increase both flexibility and efficiency in a production line environment. In this setup, human workers can be assigned tasks that require high perceptual ability, dexterity and judgement, supplemented by robotic assistants that can perform work of low (skill) value, such as fetching and delivering parts and tools. Key to such a strategy is the ability of the automated system to maintain total awareness of the states of all key players (humans, robots, machinery, parts) and take the necessary action to carry out the manufacturing while maintaining the safety of the human workers. We refer to this attribute as Situational Awareness, and in this paper present both an implementation and a case study in the form of a system that tracks the articulated 3D pose of a group of human workers in an enclosed area.

[1]  D. Corkill Blackboard Systems , 1991 .

[2]  Daniel D. Corkill,et al.  Achieving Flexibility, Efficiency, and Generality in Blackboard Architectures , 1987, AAAI.

[3]  Alin Albu-Schäffer,et al.  The KUKA-DLR Lightweight Robot arm - a new reference platform for robotics research and manufacturing , 2010, ISR/ROBOTIK.

[4]  Esteban Walter Gonzalez Clua,et al.  A Comparison between Background Subtraction Algorithms using a Consumer Depth Camera , 2012, VISAPP.

[5]  Vittorio Scarano,et al.  VENNFS: a Venn-diagram file manager , 2003, Proceedings on Seventh International Conference on Information Visualization, 2003. IV 2003..

[6]  Antonio Bicchi,et al.  Safety for Physical Human-Robot Interaction , 2008, Springer Handbook of Robotics.

[7]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[8]  Michael A. Goodrich,et al.  Human-Robot Interaction: A Survey , 2008, Found. Trends Hum. Comput. Interact..

[9]  Sebastian Thrun,et al.  Real-time identification and localization of body parts from depth images , 2010, 2010 IEEE International Conference on Robotics and Automation.

[10]  M. Hagele,et al.  rob@work: Robot assistant in industrial environments , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[11]  Björn Matthias,et al.  Safety of Industrial Robots: From Conventional to Collaborative Applications , 2012, ROBOTIK.

[12]  Feng Duan,et al.  Human-robot collaboration in cellular manufacturing: Design and development , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Alexander Verl,et al.  Cooperation of human and machines in assembly lines , 2009 .

[14]  Nassir Navab,et al.  Human skeleton tracking from depth data using geodesic distances and optical flow , 2012, Image Vis. Comput..

[15]  Kenneth N. McKay Computers in industry: Diebold's view from mid-century , 2000, Int. J. Comput. Integr. Manuf..

[16]  Victor R. Lesser,et al.  The Hearsay-II Speech-Understanding System: Integrating Knowledge to Resolve Uncertainty , 1980, CSUR.