Human and Workcell Event Recognition and Its Application Areas in Industrial Assembly

Assistance systems in production gain increased importance for industry, to tackle the challenges of mass customization and the demographic change. Common to these systems is the need for context awareness and understanding of the state of an assembly process. This paper presents an approach towards Event Recognition in manual assembly settings and introduces concepts to apply this key technology to the application areas of Quality Assurance, Worker Assistance, and Process Teaching.

[1]  Bernhard Rinner,et al.  Toward an Interactive Reinforcement Based Learning Framework for Human Robot Collaborative Assembly Processes , 2018, Front. Robot. AI.

[2]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[3]  Yunde Jia,et al.  Parsing video events with goal inference and intent prediction , 2011, 2011 International Conference on Computer Vision.

[4]  Gordon Cheng,et al.  A survey on semantic-based methods for the understanding of human movements , 2019, Robotics Auton. Syst..

[5]  Nicu Sebe,et al.  Context-Based Object-Class Recognition and Retrieval by Generalized Correlograms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Daijin Kim,et al.  Robust human activity recognition from depth video using spatiotemporal multi-fused features , 2017, Pattern Recognit..

[7]  Amit K. Roy-Chowdhury,et al.  Context-Aware Activity Recognition and Anomaly Detection in Video , 2013, IEEE Journal of Selected Topics in Signal Processing.

[8]  Ronald Poppe,et al.  A survey on vision-based human action recognition , 2010, Image Vis. Comput..

[9]  Gérard G. Medioni,et al.  Context tracker: Exploring supporters and distracters in unconstrained environments , 2011, CVPR 2011.

[10]  Thorsten Liebig,et al.  GraphScale: Adding Expressive Reasoning to Semantic Data Stores , 2015, International Semantic Web Conference.

[11]  Kristina Chodorow,et al.  MongoDB - The Definitive Guide: Powerful and Scalable Data Storage , 2019 .

[12]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Bernhard Rinner,et al.  Towards a Context Enhanced Framework for Multi Object Tracking in Human Robot Collaboration , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Moritz Tenorth,et al.  Representations for robot knowledge in the KnowRob framework , 2017, Artif. Intell..

[15]  Stephen J. Maybank,et al.  Activity recognition using a supervised non-parametric hierarchical HMM , 2016, Neurocomputing.

[16]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Kai-Tai Song,et al.  CAD-based pose estimation for random bin-picking of multiple objects using a RGB-D camera , 2015, 2015 15th International Conference on Control, Automation and Systems (ICCAS).

[18]  Mauro Onori,et al.  Smart Power Tools: An Industrial Event-Driven Architecture Implementation , 2018 .

[19]  Andreas Pichler,et al.  Tracking multiple rigid symmetric and non-symmetric objects in real-time using depth data , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[20]  Bernhard Rinner,et al.  Human Robot Collaboration to Reach a Common Goal in an Assembly Process , 2016, STAIRS.

[21]  Timothy Patten,et al.  SyDPose: Object Detection and Pose Estimation in Cluttered Real-World Depth Images Trained using Only Synthetic Data , 2019, 2019 International Conference on 3D Vision (3DV).

[22]  Andreas Pichler,et al.  Skill-based programming of complex robotic assembly tasks for industrial application , 2019, e & i Elektrotechnik und Informationstechnik.

[23]  Manfred Tscheligi,et al.  Industrial Assistance as an I4.0 Topic—MMAssist: Assistance in Production in the Context of Human–Machine Cooperation , 2019 .

[24]  Nassir Navab,et al.  A Versatile Learning-Based 3D Temporal Tracker: Scalable, Robust, Online , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[25]  Wolfram Wöß,et al.  Towards a Definition of Knowledge Graphs , 2016, SEMANTiCS.