Using RGB-D sensors and evolutionary algorithms for the optimization of workstation layouts.

RGB-D sensors can collect postural data in an automatized way. However, the application of these devices in real work environments requires overcoming problems such as lack of accuracy or body parts' occlusion. This work presents the use of RGB-D sensors and genetic algorithms for the optimization of workstation layouts. RGB-D sensors are used to capture workers' movements when they reach objects on workbenches. Collected data are then used to optimize workstation layout by means of genetic algorithms considering multiple ergonomic criteria. Results show that typical drawbacks of using RGB-D sensors for body tracking are not a problem for this application, and that the combination with intelligent algorithms can automatize the layout design process. The procedure described can be used to automatically suggest new layouts when workers or processes of production change, to adapt layouts to specific workers based on their ways to do the tasks, or to obtain layouts simultaneously optimized for several production processes.

[1]  X. F. Zha,et al.  Intelligent design and planning of manual assembly workstations: a neuro-fuzzy approach , 2003 .

[2]  Gurunath V Shinde,et al.  Ergonomic analysis of an assembly workstation to identify time consuming and fatigue causing factors using application of motion study , 2012 .

[3]  Petros Daras,et al.  Estimating human motion from multiple Kinect sensors , 2013, MIRAGE '13.

[4]  Xuan F. Zha Soft computing framework for intelligent human–machine system design, simulation and optimization , 2003, Soft Comput..

[5]  K. Y. Tam,et al.  Genetic algorithms, function optimization, and facility layout design , 1992 .

[6]  Rahul Nair,et al.  A State of the Art Report on Kinect Sensor Setups in Computer Vision , 2013, Time-of-Flight and Depth Imaging.

[7]  Jose Antonio Diego-Mas,et al.  Slicing tree's geometric potential: an indicator for layout problems based on slicing tree structure , 2008 .

[8]  M A Brodie,et al.  The static accuracy and calibration of inertial measurement units for 3D orientation , 2008, Computer methods in biomechanics and biomedical engineering.

[9]  B. Freisleben,et al.  A comparison of memetic algorithms, tabu search, and ant colonies for the quadratic assignment problem , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[10]  Lalit M. Patnaik,et al.  Genetic algorithms: a survey , 1994, Computer.

[11]  Ashraf A. Shikdar,et al.  Smart workstation design: an ergonomics and methods engineering approach , 2007 .

[12]  Haoxun Chen,et al.  Ant colony optimization for solving an industrial layout problem , 2007, Eur. J. Oper. Res..

[13]  J. Diego-Mas,et al.  Solving facility layout problems with strict geometric constraints using a two-phase genetic algorithm , 2009 .

[14]  Saeid Nahavandi,et al.  Real Time Ergonomic Assessment for Assembly Operations Using Kinect , 2013, 2013 UKSim 15th International Conference on Computer Modelling and Simulation.

[15]  Svend Erik Mathiassen,et al.  Data collection costs in industrial environments for three occupational posture exposure assessment methods , 2012, BMC Medical Research Methodology.

[16]  Linda Denehy,et al.  Validity of the Microsoft Kinect for assessment of postural control. , 2012, Gait & posture.

[17]  Raymond W. McGorry,et al.  The validity of the first and second generation Microsoft Kinect™ for identifying joint center locations during static postures. , 2015, Applied ergonomics.

[18]  Javier Santos,et al.  Using ergonomic software in non-repetitive manufacturing processes: A case study , 2007 .

[19]  Franck Multon,et al.  Pose Estimation with a Kinect for Ergonomic Studies: Evaluation of the Accuracy Using a Virtual Mannequin , 2015, Sensors.

[20]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[21]  Rezaul Begg,et al.  Overview of movement analysis and gait features , 2006 .

[22]  Sander Oude Elberink,et al.  Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications , 2012, Sensors.

[23]  Mark S. Sanders,et al.  Human Factors in Engineering and Design , 2016 .

[24]  Thomas Stützle,et al.  Tabu search vs. simulated annealing as a function of the size of quadratic assignment problem instances , 2014, Comput. Oper. Res..

[25]  Florian Geiselhart,et al.  On the Use of Multi-Depth-Camera Based Motion Tracking Systems in Production Planning Environments , 2016 .

[26]  Marimuthu Palaniswami,et al.  Computational intelligence for movement sciences : neural networks and other emerging techniques , 2006 .

[27]  M. Adel El-Baz,et al.  A genetic algorithm for facility layout problems of different manufacturing environments , 2004, Comput. Ind. Eng..

[28]  Adso Fernández-Baena,et al.  Biomechanical Validation of Upper-Body and Lower-Body Joint Movements of Kinect Motion Capture Data for Rehabilitation Treatments , 2012, 2012 Fourth International Conference on Intelligent Networking and Collaborative Systems.

[29]  Dieter Fox,et al.  RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments , 2012, Int. J. Robotics Res..

[30]  Daniel Cremers,et al.  Real-time human motion tracking using multiple depth cameras , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Stephen Bao,et al.  Automation of Workplace Lifting Hazard Assessment for Musculoskeletal Injury Prevention , 2014, Annals of Occupational and Environmental Medicine.

[32]  Adi Saptari,et al.  Jig Design, Assembly Line Design and Work Station Design and their Effect to Productivity , 2011 .

[33]  Harald Dyckhoff,et al.  A typology of cutting and packing problems , 1990 .

[34]  Jose Antonio Diego-Mas,et al.  Using Kinect™ sensor in observational methods for assessing postures at work. , 2014, Applied ergonomics.

[35]  Ben A. M. Schouten,et al.  Games for Health , 2013, Springer Fachmedien Wiesbaden.

[36]  A. A. Islier A genetic algorithm approach for multiple criteria facility layout design , 1998 .

[37]  Fred W. Glover,et al.  Multistart Tabu Search and Diversification Strategies for the Quadratic Assignment Problem , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[38]  Ashraf A Shikdar,et al.  Office Ergonomics: Deficiencies in Computer Workstation Design , 2007, International journal of occupational safety and ergonomics : JOSE.

[39]  Andreas Kolb,et al.  Kinect range sensing: Structured-light versus Time-of-Flight Kinect , 2015, Comput. Vis. Image Underst..

[40]  Umut Rifat Tuzkaya,et al.  A particle swarm optimization algorithm for the multiple-level warehouse layout design problem , 2008, Comput. Ind. Eng..

[41]  Biman Das,et al.  Determination of the normal horizontal working area: a new model and method , 1995 .

[42]  Kai Berger A State Of the Art Report on Research in Multiple RGB-D sensor Setups , 2013, ArXiv.

[43]  Victor Sholukha,et al.  From KinectTM to anatomically-correct motion modelling: Preliminary results for human application , 2013, GFHEU.

[44]  Alexandra Pfister,et al.  Comparative abilities of Microsoft Kinect and Vicon 3D motion capture for gait analysis , 2014, Journal of medical engineering & technology.

[45]  Ahmad Rasdan Ismail,et al.  An Ergonomics Study on Assembly Line Workstation Design , 2011 .

[46]  Ettore Pennestrì,et al.  Comparison between low-cost marker-less and high-end marker-based motion capture systems for the computer-aided assessment of working ergonomics , 2016, Ergonomics.

[47]  André R. S. Amaral On the exact solution of a facility layout problem , 2006, Eur. J. Oper. Res..

[48]  Noel E. O'Connor,et al.  Low-cost accurate skeleton tracking based on fusion of kinect and wearable inertial sensors , 2014, 2014 22nd European Signal Processing Conference (EUSIPCO).

[49]  Kazuyuki Aihara,et al.  A novel chaotic search for quadratic assignment problems , 2002, Eur. J. Oper. Res..

[50]  B Das,et al.  Industrial workstation design: a systematic ergonomics approach. , 1996, Applied ergonomics.

[51]  Tilak Dutta,et al.  Evaluation of the Kinect™ sensor for 3-D kinematic measurement in the workplace. , 2012, Applied ergonomics.

[52]  Kelly J. Bower,et al.  Concurrent validity of the Microsoft Kinect for assessment of spatiotemporal gait variables. , 2013, Journal of biomechanics.

[53]  Pankaj Kumar Sharma,et al.  Solving job shop layout problem using ant colony optimization technique , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[54]  Ashraf A. Shikdar,et al.  Evaluation of a low-cost ergonomically designed adjustable assembly workstation , 2012 .

[55]  Ling Shao,et al.  Enhanced Computer Vision With Microsoft Kinect Sensor: A Review , 2013, IEEE Transactions on Cybernetics.

[56]  Stepán Obdrzálek,et al.  Accuracy and robustness of Kinect pose estimation in the context of coaching of elderly population , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[57]  B Bonnechère,et al.  Validity and reliability of the Kinect within functional assessment activities: comparison with standard stereophotogrammetry. , 2014, Gait & posture.

[58]  Maurizio Faccio,et al.  New methodological framework to improve productivity and ergonomics in assembly system design , 2011 .

[59]  Henri Pierreval,et al.  Facility layout problems: A survey , 2007, Annu. Rev. Control..

[60]  Andrew Kusiak,et al.  The facility layout problem , 1987 .

[61]  Joseph M Mahoney,et al.  Design method for multi-user workstations utilizing anthropometry and preference data. , 2015, Applied ergonomics.

[62]  Lin Yang,et al.  Evaluating and Improving the Depth Accuracy of Kinect for Windows v2 , 2015, IEEE Sensors Journal.

[63]  Ayanna M. Howard,et al.  Quantitative evaluation of the Microsoft KinectTM for use in an upper extremity virtual rehabilitation environment , 2013, 2013 International Conference on Virtual Rehabilitation (ICVR).