Optimal Selection of the Workpiece Recognition Parameters by Minimizing the Total Error Cost

Abstract Workpiece recognition is crucial in many flexible assembly cells, in automatic unmanned workstations and in robotic cells for human-robot collaborative scenarios. It allows for variability in the workpiece location & pose, and timing of the various operations. Automatic object recognition systems often rely on supervised machine learning methods, their parameters have to be chosen before training and cannot be changed later in runtime. In many machine learning applications the parameters are chosen in order to optimize the measures of relevance: accuracy, precision and recall. Usually these conflicting performance metrics are optimized independently from production costs. The innovation of present study is the introduction of a new metric to be optimized, a dimensionless total cost. It is a linear combination of the false positive and the false negative rates which are directly proportional to the real-life costs of errors. The presented case study, an object recognition system for reflective workpieces, is applied the proposed parameter selection to achieve optimal results with minimum production costs.

[1]  Peter Nyhuis,et al.  Changeable Manufacturing - Classification, Design and Operation , 2007 .

[2]  Gilles Louppe,et al.  Independent consultant , 2013 .

[3]  John T. Wen,et al.  A Sensor-Based Dual-Arm Tele-Robotic System , 2015, IEEE Transactions on Automation Science and Engineering.

[4]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[5]  Charles Elkan,et al.  The Foundations of Cost-Sensitive Learning , 2001, IJCAI.

[6]  Philip H. S. Torr,et al.  BING: Binarized normed gradients for objectness estimation at 300fps , 2014, Computational Visual Media.

[7]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[8]  Nando de Freitas,et al.  A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning , 2010, ArXiv.

[9]  Hoda A. ElMaraghy,et al.  Flexible and reconfigurable manufacturing systems paradigms , 2005 .

[10]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[11]  Giovanna Sansoni,et al.  Roboscan: a combined 2D and 3D vision system for improved speed and flexibility in pick-and-place operation , 2013, The International Journal of Advanced Manufacturing Technology.

[12]  Douglas M. Hawkins,et al.  The Problem of Overfitting , 2004, J. Chem. Inf. Model..

[13]  Ales Pochyly,et al.  Robotic Vision for Bin-Picking Applications of Various Objects , 2010, ISR/ROBOTIK.

[14]  Kai Ming Ting,et al.  Precision and Recall , 2017, Encyclopedia of Machine Learning and Data Mining.

[15]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[16]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[18]  M. Zweig,et al.  Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. , 1993, Clinical chemistry.

[19]  Sangseung Kang,et al.  Bin picking for the objects of non-Lambertian reflectance without using an explicit object model , 2014, 2014 11th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[20]  Sylvain Arlot,et al.  A survey of cross-validation procedures for model selection , 2009, 0907.4728.

[21]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[22]  Siddhartha S. Srinivasa,et al.  Object recognition and full pose registration from a single image for robotic manipulation , 2009, 2009 IEEE International Conference on Robotics and Automation.

[23]  Victor S. Sheng,et al.  Cost-Sensitive Learning , 2009, Encyclopedia of Data Warehousing and Mining.

[24]  Horst Bischof,et al.  Robust Recognition Using Eigenimages , 2000, Comput. Vis. Image Underst..

[25]  Dumitru Erhan,et al.  Deep Neural Networks for Object Detection , 2013, NIPS.

[26]  Philip H. S. Torr,et al.  Probabilistic active recognition of multiple objects using Hough-based geometric matching features , 2015 .

[27]  Jasper Snoek,et al.  Practical Bayesian Optimization of Machine Learning Algorithms , 2012, NIPS.

[28]  Ali Borji,et al.  Salient Object Detection: A Benchmark , 2015, IEEE Transactions on Image Processing.

[29]  Vitor Santos,et al.  Object recognition and pose estimation for industrial applications: A cascade system , 2014 .