Improving Test and Diagnosis Efficiency through Ensemble Reduction and Learning

Machine learning is a powerful lever for developing, improving, and optimizing test methodologies to cope with the demand from the advanced nodes. Ensemble methods are a particular learning paradigm that uses multiple models to boost performance. In this work, ensemble reduction and learning is explored for integrated circuit test and diagnosis. For testing, the proposed method is able to reduce the number of system-level tests without incurring substantial increase in defect escapes or yield losses. Significant cost from test execution and set-up preparation can thereby be saved. Experiments are performed on two designs of commercially fabricated chips, for an overall population of >264,000 chips. The results demonstrate that our method is able to reduce 29.27% and 21.74% of the number of tests for the two chips, respectively, at the cost of very low defect escapes. For failure diagnosis, the framework is able to predict an adequate amount of test data necessary for accurate failure diagnosis. Experiments performed on five standard benchmarks demonstrate that our method outperforms a state-of-the-art work in terms of data-volume reduction. The proposed ensemble-based methodology creates opportunities for improving test and diagnosis efficiency.

[1]  Li-C. Wang,et al.  Generalization of an outlier model into a “global” perspective , 2015, 2015 IEEE International Test Conference (ITC).

[2]  R. D. Blanton,et al.  Reducing test cost of integrated, heterogeneous systems using pass-fail test data analysis , 2014, TODE.

[3]  Peter Sarson,et al.  Variation and failure characterization through pattern classification of test data from multiple test stages , 2016, 2016 IEEE International Test Conference (ITC).

[4]  Ji Feng,et al.  Deep Forest: Towards An Alternative to Deep Neural Networks , 2017, IJCAI.

[5]  Lior Rokach,et al.  Ensemble-based classifiers , 2010, Artificial Intelligence Review.

[6]  Vishwani D. Agrawal,et al.  Essentials of electronic testing for digital, memory, and mixed-signal VLSI circuits [Book Review] , 2000, IEEE Circuits and Devices Magazine.

[7]  Hiroshi Takahashi,et al.  Compaction of pass/fail-based diagnostic test vectors for combinational and sequential circuits , 2006, Asia and South Pacific Conference on Design Automation, 2006..

[8]  Magdy S. Abadir,et al.  A pattern mining framework for inter-wafer abnormality analysis , 2013, 2013 IEEE International Test Conference (ITC).

[9]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[10]  Florence March,et al.  2016 , 2016, Affair of the Heart.

[11]  Mango Chia-Tso Chao,et al.  Statistical techniques for predicting system-level failure using stress-test data , 2015, 2015 IEEE 33rd VLSI Test Symposium (VTS).

[12]  寺岡 寛,et al.  Engineering Economics , 2018, Nature.

[13]  Pietro Babighian,et al.  Systematic defect detection methodology for volume diagnosis: A data mining perspective , 2017, 2017 IEEE International Test Conference (ITC).

[14]  Srikanth Venkataraman,et al.  POIROT: a logic fault diagnosis tool and its applications , 2000, Proceedings International Test Conference 2000 (IEEE Cat. No.00CH37159).

[15]  S. M. García,et al.  2014: , 2020, A Party for Lazarus.

[16]  Yiorgos Makris,et al.  Harnessing process variations for optimizing wafer-level probe-test flow , 2016, 2016 IEEE International Test Conference (ITC).

[17]  R. D. Blanton,et al.  Ensemble Reduction via Logic Minimization , 2016, TODE.

[18]  Sabrina Hirsch,et al.  Logic Minimization Algorithms For Vlsi Synthesis , 2016 .

[19]  Magdy S. Abadir,et al.  Yield optimization using advanced statistical correlation methods , 2014, 2014 International Test Conference.

[20]  Gonzalo Martínez-Muñoz,et al.  Pruning in ordered bagging ensembles , 2006, ICML.

[21]  Harry H. Chen,et al.  Predicting system-level test and in-field customer failures using data mining , 2013, 2013 IEEE International Test Conference (ITC).

[22]  Sarveswara Tammali Industrial practices of test cost reduction: Perspective, current design practices , 2010, VTS.

[23]  Li-C. Wang,et al.  Kernel based clustering for quality improvement and excursion detection , 2017, 2017 IEEE International Test Conference (ITC).

[24]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[25]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[26]  A. James 2010 , 2011, Philo of Alexandria: an Annotated Bibliography 2007-2016.

[27]  Abhijit Chatterjee,et al.  Predicting die-level process variations from wafer test data for analog devices: A feasibility study , 2013, 2013 14th Latin American Test Workshop - LATW.

[28]  Janusz Rajski,et al.  Compactor independent direct diagnosis , 2004, 13th Asian Test Symposium.

[29]  Xin Li,et al.  Improving Diagnostic Resolution of Failing ICs Through Learning , 2018, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[30]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[31]  Irith Pomeranz,et al.  A Joint Diagnostic Test Generation Procedure with Dynamic Test Compaction , 2016, 2016 IEEE 25th Asian Test Symposium (ATS).

[32]  Wojciech Maly,et al.  Fault tuples in diagnosis of deep-submicron circuits , 2002, Proceedings. International Test Conference.

[33]  Yiorgos Makris,et al.  Yield forecasting in fab-to-fab production migration based on Bayesian Model Fusion , 2015, 2015 IEEE/ACM International Conference on Computer-Aided Design (ICCAD).

[34]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[35]  Andrew B. Kahng,et al.  New directions for learning-based IC design tools and methodologies , 2018, 2018 23rd Asia and South Pacific Design Automation Conference (ASP-DAC).

[36]  R. D. Blanton,et al.  SLIDER: Simulation of Layout-Injected Defects for Electrical Responses , 2012, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[37]  Patrick D.T. O'Connor The Economics of Automatic Testing , 1983 .

[38]  Kai-Jie Yang,et al.  Test Pattern Compression for Probabilistic Circuits , 2017, 2017 IEEE 26th Asian Test Symposium (ATS).

[39]  R. D. Blanton,et al.  Detection of illegitimate access to JTAG via statistical learning in chip , 2015, 2015 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[40]  R. D. Blanton,et al.  Test-data volume optimization for diagnosis , 2012, DAC Design Automation Conference 2012.

[41]  R. D. Blanton,et al.  Statistical Test Compaction Using Binary Decision Trees , 2006, IEEE Design & Test of Computers.

[42]  Magdy S. Abadir,et al.  Data mining in EDA - Basic principles, promises, and constraints , 2014, 2014 51st ACM/EDAC/IEEE Design Automation Conference (DAC).

[43]  Bruce Cory,et al.  An Industrial Study of System-Level Test , 2012, IEEE Design & Test of Computers.

[44]  Andreas Holzinger,et al.  Data Mining with Decision Trees: Theory and Applications , 2015, Online Inf. Rev..

[45]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[46]  Vivek Chickermane,et al.  Advancing test compression to the physical dimension , 2017, 2017 IEEE International Test Conference (ITC).

[47]  Xindong Wu,et al.  Ensemble pruning via individual contribution ordering , 2010, KDD.

[48]  Pramodita Sharma 2012 , 2013, Les 25 ans de l’OMC: Une rétrospective en photos.

[49]  Giovanni De Micheli,et al.  Synthesis and Optimization of Digital Circuits , 1994 .

[50]  William Nick Street,et al.  Ensemble Pruning Via Semi-definite Programming , 2006, J. Mach. Learn. Res..

[51]  John Langford,et al.  Scaling up machine learning: parallel and distributed approaches , 2011, KDD '11 Tutorials.

[52]  Yiorgos Makris,et al.  Non-RF to RF Test Correlation Using Learning Machines: A Case Study , 2007, 25th IEEE VLSI Test Symposium (VTS'07).

[53]  Andreas G. Veneris,et al.  Clustering-based failure triage for RTL regression debugging , 2014, 2014 International Test Conference.

[54]  Ian Witten,et al.  Data Mining , 2000 .

[55]  Li-C. Wang,et al.  Learning the process for correlation analysis , 2017, 2017 IEEE 35th VLSI Test Symposium (VTS).