Toward metrics of design automation research impact

Design automation (DA) research has for over fifty years been performed in academia, semiconductor and system companies, and EDA companies worldwide. This research has been enabling to continued scaling of design productivity and growth of the semiconductor industry. For product companies, funding program managers and individual researchers alike, a highly relevant question is: what DA research, and what DA research outcomes, ultimately have the greatest “impact”? In this paper, we present measurements and analyses of DA research outputs (papers, patents, EDA companies), upon which future metrics of DA research impact might be based. Our studies consider 47000+ conference and journal papers from 1964-2014; the inter-patent citation graph over 759000+ DA-related patents; abstracts of 1150+ U.S. NSF projects over a three-decade span; 36 research needs documents of the Semiconductor Research Corporation from 2000-2013; and market segmentation of hundreds of EDA companies. We identify several interesting correlations, but do not claim to identify causal relationships; indeed, connecting traditional measures of research output to real-world impacts seems quite challenging. We conclude with several directions and targets for future investigation.

[1]  Christopher Gonzalez,et al.  5.1 POWER8TM: A 12-core server-class processor in 22nm SOI with 7.6Tb/s off-chip bandwidth , 2014, 2014 IEEE International Solid-State Circuits Conference Digest of Technical Papers (ISSCC).

[2]  Gary Smith.  Updates of the ITRS design cost and power models , 2014, 2014 IEEE 32nd International Conference on Computer Design (ICCD).

[3]  Alberto L. Sangiovanni-Vincentelli,et al.  The Tides of EDA , 2003, IEEE Des. Test Comput..

[4]  W. Eric L. Grimson,et al.  Spatial Latent Dirichlet Allocation , 2007, NIPS.

[5]  C. Lee Giles,et al.  Clustering Scientific Literature Using Sparse Citation Graph Analysis , 2006, PKDD.

[6]  Fei-Fei Li,et al.  Spatially Coherent Latent Topic Model for Concurrent Segmentation and Classification of Objects and Scenes , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[7]  Andrew B. Kahng.  Design technology productivity in the DSM era (invited talk) , 2001, ASP-DAC '01.

[8]  Jian Pei,et al.  Detecting topic evolution in scientific literature: how can citations help? , 2009, CIKM.

[9]  T. Minka.  Estimating a Dirichlet distribution , 2012 .

[10]  Max Welling,et al.  Fast collapsed gibbs sampling for latent dirichlet allocation , 2008, KDD.

[11]  Carl Lagoze,et al.  Detecting research topics via the correlation between graphs and texts , 2007, KDD '07.

[12]  Pong-Fei Lu,et al.  Physical design of a fourth-generation POWER GHz microprocessor , 2001, 2001 IEEE International Solid-State Circuits Conference. Digest of Technical Papers. ISSCC (Cat. No.01CH37177).

[13]  Khalid Alfalqi,et al.  A Survey of Topic Modeling in Text Mining , 2015 .

[14]  Lei Chen,et al.  Classification of Topic Evolutions in Scientific Conferences , 2014, SEKE 2014.

[15]  Jure Leskovec,et al.  Hidden factors and hidden topics: understanding rating dimensions with review text , 2013, RecSys.

[16]  Chia-Hui Chang,et al.  Exploring Evolutionary Technical Trends from Academic Research Papers , 2008, 2008 The Eighth IAPR International Workshop on Document Analysis Systems.

[17]  Gaurav Mittal,et al.  Design of the Power6 Microprocessor , 2007, 2007 IEEE International Solid-State Circuits Conference. Digest of Technical Papers.

[18]  Trevor York,et al.  Book Review: Principles of CMOS VLSI Design: A Systems Perspective , 1986 .

[19]  Balaram Sinharoy,et al.  Design and implementation of the POWER5 microprocessor , 2004, Proceedings. 41st Design Automation Conference, 2004..

[20]  Jun Sun,et al.  Collective Latent Dirichlet Allocation , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[21]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[22]  David M. Blei,et al.  Supervised Topic Models , 2007, NIPS.

[23]  John D. Lafferty,et al.  Correlated Topic Models , 2005, NIPS.

[24]  Andrew T. Wilson,et al.  Tracking Topic Birth and Death in LDA , 2011 .

[25]  Hanna M. Wallach,et al.  Topic modeling: beyond bag-of-words , 2006, ICML.

[26]  Andrew McCallum,et al.  Topics over time: a non-Markov continuous-time model of topical trends , 2006, KDD '06.

[27]  Thomas Hofmann,et al.  Learning from Dyadic Data , 1998, NIPS.

[28]  Ramesh Nallapati,et al.  Joint latent topic models for text and citations , 2008, KDD.

[29]  Mark Steyvers,et al.  Finding scientific topics , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[30]  P. R. Stephan,et al.  SIS : A System for Sequential Circuit Synthesis , 1992 .

[31]  Oren Etzioni,et al.  OPINE: Extracting Product Features and Opinions from Reviews , 2005, HLT/EMNLP.

[32]  Michael I. Jordan.  Graphical Models , 2003 .

[33]  Christophe Diot,et al.  Finding a needle in a haystack of reviews: cold start context-based hotel recommender system , 2012, RecSys.

[34]  Balaram Sinharoy,et al.  The implementation of POWER7TM: A highly parallel and scalable multi-core high-end server processor , 2010, 2010 IEEE International Solid-State Circuits Conference - (ISSCC).

[35]  Andrew B. Kahng.  Design technology productivity in the DSM era , 2001, Proceedings of the ASP-DAC 2001. Asia and South Pacific Design Automation Conference 2001 (Cat. No.01EX455).

[36]  Benjamin Barras,et al.  SPICE – Simulation Program with Integrated Circuit Emphasis , 2013 .

[37]  Wai Lam,et al.  An unsupervised topic segmentation model incorporating word order , 2013, SIGIR.

[38]  Sebastian Thrun,et al.  Text Classification from Labeled and Unlabeled Documents using EM , 2000, Machine Learning.

[39]  Yuan An,et al.  Characterizing and Mining Citation Graph of Computer Science Literature , 2001 .

[40]  Erkki Sutinen,et al.  Applying Latent Dirichlet Allocation to Automatic Essay Grading , 2006, FinTAL.

[41]  Matthew M. Ziegler,et al.  POWER8 design methodology innovations for improving productivity and reducing power , 2014, Proceedings of the IEEE 2014 Custom Integrated Circuits Conference.

[42]  Oren Etzioni,et al.  Extracting Product Features and Opinions from Reviews , 2005, HLT.

[43]  David J. C. MacKay,et al.  A hierarchical Dirichlet language model , 1995, Natural Language Engineering.

[44]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..

[45]  Andrew B. Kahng,et al.  A new design cost model for the 2001 ITRS , 2002, Proceedings International Symposium on Quality Electronic Design.

[46]  Loet Leydesdorff,et al.  Betweenness centrality as an indicator of the interdisciplinarity of scientific journals , 2007, J. Assoc. Inf. Sci. Technol..