Exploiting Auto-adaptive 7GP for Highly Effective Test Programs Generation

Integrated-circuit producers are shoved by competitive pressure; new devices require increasingly complex verifications to be performed at increasing pace. This paper presents a methodology to automatically induce a test program for a microprocessor that maximizes a given verification metric. The methodology is based on an auto-adaptive evolutionary algorithm and exploits a syntactical description of microprocessor assembly language and an RT-level functional model. Experimental results clearly show the effectiveness of the approach. Comparisons reveal how auto-adaptive mechanisms dramatically enhance both performances and quality of the results.

[1]  Randolph A. Miller,et al.  The effects on clinician ordering patterns of a computerized decision support system for neuroradiology imaging studies , 2001, AMIA.

[2]  T D East,et al.  Computerized decision support for mechanical ventilation of trauma induced ARDS: results of a randomized clinical trial. , 2001, The Journal of trauma.

[3]  J. Kellett,et al.  Decision support and the appropriate use of fibrinolysis in myocardial infarction. , 2001, Effective clinical practice : ECP.

[4]  G J Kuperman,et al.  A randomized trial of a computer-based intervention to reduce utilization of redundant laboratory tests. , 1999, The American journal of medicine.

[5]  A. Halligan,et al.  Implementing clinical governance: turning vision into reality , 2001, BMJ : British Medical Journal.

[6]  G. Mires,et al.  Use of a computerised maternity information system to improve clinical effectiveness: thromboprophylaxis at caesarean section , 2000, Postgraduate medical journal.

[7]  John Morrissey Doctor's orders. Computerized decision-support system directs Vanderbilt physicians to the latest treatment data, helping to eliminate unnecessary costs. , 2002, Modern healthcare.

[8]  Z R Li,et al.  A decision-support system for the analysis of clinical practice patterns. , 1994, Proceedings. Symposium on Computer Applications in Medical Care.

[9]  E. Murphy,et al.  Evaluating medical information systems: ethnomethodological and interactionist approaches , 2001, Health services management research.

[10]  Martin Dugas,et al.  Interactive decision support in hepatic surgery , 2002, BMC Medical Informatics Decis. Mak..

[11]  H. Lærum,et al.  Doctors' use of electronic medical records systems in hospitals: cross sectional survey , 2001, BMJ : British Medical Journal.

[12]  W M Tierney,et al.  Effectiveness of Computer-Generated Reminders for Increasing Discussions about Advance Directives and Completion of Advance Directive Forms , 1998, Annals of Internal Medicine.

[13]  Takeo Ishigaki,et al.  A Signal-detection Experiment Measuring the Effect of Computer-aided Detection on Radiologists' Performance , 2000, Medical decision making : an international journal of the Society for Medical Decision Making.

[14]  C J McDonald,et al.  Computer reminders to implement preventive care guidelines for hospitalized patients. , 1996, Archives of internal medicine.

[15]  A. Shaw,et al.  Evaluation of the impact of a bedside terminal system in a rapidly changing community hospital. , 1995, Computers in nursing.

[16]  Paul N. Gorman,et al.  Physician order entry in U.S. hospitals , 1998, AMIA.

[17]  Frank Sullivan,et al.  Has general practitioner computing made a difference to patient care? A systematic review of published reports , 1995, BMJ.

[18]  H L Smith,et al.  Does Information Technology Make a Difference in Healthcare Organization Performance? A Multiyear Study , 2000, Hospital topics.

[19]  P Dunbar,et al.  How To Analyze The Benefits And Return On Investment Of A Perioperative Information System , 1999 .

[20]  T. Clemmer,et al.  A computer-assisted management program for antibiotics and other antiinfective agents. , 1998, The New England journal of medicine.

[21]  M. Pradhan,et al.  The intersection of health informatics and evidence‐based medicine: computer‐based systems to assist clinicians , 2000, The Medical journal of Australia.

[22]  B. Bornstein,et al.  Rationality in medical decision making: a review of the literature on doctors' decision-making biases. , 2001, Journal of evaluation in clinical practice.

[23]  Robert Grundmeier,et al.  Housestaff attitudes toward computer-based clinical decision support , 1999, AMIA.

[24]  R. Raschke,et al.  A computer alert system to prevent injury from adverse drug events: development and evaluation in a community teaching hospital. , 1998, JAMA.

[25]  N Freemantle,et al.  When is it cost-effective to change the behavior of health professionals? , 2001, JAMA.

[26]  M. Eccles,et al.  Improving health care through professional behaviour change: introducing a framework for identifying behaviour change strategies , 1999 .

[27]  J I Westbrook,et al.  Patient satisfaction: methodological issues and research findings. , 1993, Australian health review : a publication of the Australian Hospital Association.

[28]  Jeremy C Wyatt,et al.  Helping clinicians to find data and avoid delays , 1998, The Lancet.

[29]  M Peters,et al.  Implementation of rules based computerised bedside prescribing and administration: intervention study , 2000, BMJ : British Medical Journal.

[30]  C. McDonald,et al.  Physician inpatient order writing on microcomputer workstations. Effects on resource utilization. , 1993, JAMA.

[31]  Elske Ammenwerth,et al.  Nursing process documentation systems in clinical routine - prerequisites and experiences , 2001, Int. J. Medical Informatics.

[32]  Ottar Aase,et al.  Clinical Experience with a Decision Support Computer Program Using Bayes’ Theorem to Diagnose Chest Pain Patients , 2000, Cardiology.

[33]  C. McDonald,et al.  A computerized reminder system to increase the use of preventive care for hospitalized patients. , 2001, The New England journal of medicine.

[34]  F D Hobbs,et al.  Can computerised decision support systems deliver improved quality in primary care? , 1999, BMJ.

[35]  S A Spooner,et al.  Medical informatics and pediatrics. , 1996, Archives of pediatrics & adolescent medicine.

[36]  K L White,et al.  Peer review: impact of a system based on billing claims. , 1974, The New England journal of medicine.

[37]  R. Cushman,et al.  n Serious Technology Assessment for Health Care Information Technology , 2022 .

[38]  Charles P. Friedman,et al.  Evaluation Methods in Medical Informatics , 1997, Computers and Medicine.

[39]  G. Schiff,et al.  Computerized prescribing: building the electronic infrastructure for better medication usage. , 1998, JAMA.

[40]  J. Holmen,et al.  Implementing clinical guidelines in the treatment of hypertension in general practice. Evaluation of patient outcome related to implementation of a computer-based clinical decision support system. , 1999, Scandinavian journal of primary health care.

[41]  Tom Fahey,et al.  Evaluation of computer based clinical decision support system and risk chart for management of hypertension in primary care: randomised controlled trial , 2000, BMJ : British Medical Journal.

[42]  Cj Mcdonald,et al.  Remin-ders to Physicians from an Introspective Computer Medical Record , 2020 .

[43]  J. Marc Overhage,et al.  Research Paper: Controlled Trial of Direct Physician Order Entry: Effects on Physicians' Time Utilization in Ambulatory Primary Care Internal Medicine Practices , 2001, J. Am. Medical Informatics Assoc..

[44]  R. R. West,et al.  Evidence based medicine overviews, bulletins, guidelines, and the new consensus , 2000, Postgraduate medical journal.

[45]  M D McNeely,et al.  The influence of an expert system for test ordering and interpretation on laboratory investigations. , 1999, Clinical chemistry.

[46]  D. Classen,et al.  Adverse drug events in hospitalized patients. Excess length of stay, extra costs, and attributable mortality. , 1997, JAMA.

[47]  Jonathan Dartnell,et al.  Improving antibiotic use: 25 years of antibiotic guidelines and related initiatives. , 2003, Communicable diseases intelligence quarterly report.

[48]  Richard M. Friedberg,et al.  A Learning Machine: Part I , 1958, IBM J. Res. Dev..

[49]  Jainendra Kumar Prototyping the M68060 for Concurrent Verification , 1997, IEEE Des. Test Comput..

[50]  Denis J. Protti,et al.  A proposal to use a balanced scorecard to evaluate Information for Health: an information strategy for the modern NHS (1998-2005) , 2002, Comput. Biol. Medicine.

[51]  M. Cabana,et al.  Why don't physicians follow clinical practice guidelines? A framework for improvement. , 1999, JAMA.

[52]  R. Foy,et al.  Barriers to clinical guidelines: the need for concerted action , 2001 .

[53]  E. Kilpatrick,et al.  Use of computer terminals on wards to access emergency test results: a retrospective audit , 2001, BMJ : British Medical Journal.

[54]  Tor Guimaraes,et al.  The Determinants of DSS Success: An Integrated Model* , 1992 .

[55]  Jack Belzer,et al.  Encyclopedia of Computer Science and Technology , 2002 .

[56]  D. Bates,et al.  Guided medication dosing for inpatients with renal insufficiency. , 2001, JAMA.

[57]  D. Wennberg,et al.  LEAPFROG PATIENT SAFETY STANDARDS The Potential Benefits of Universal Adoption November 2000 , 2000 .

[58]  Timothy M. Franz,et al.  Enhancement of clinicians' diagnostic reasoning by computer-based consultation: a multisite study of 2 systems. , 1999, JAMA.

[59]  Giovanni Squillero,et al.  Evolutionary test program induction for microprocessor design verification , 2002, Proceedings of the 11th Asian Test Symposium, 2002. (ATS '02)..

[60]  T. Wilt,et al.  Effect of Written and Computerized Decision Support Aids for the U.S. Agency for Health Care Policy and Research Depression Guidelines on the Evaluation of Hypothetical Clinical Scenarios , 2001, Medical decision making : an international journal of the Society for Medical Decision Making.

[61]  James G. Anderson,et al.  Evaluation in health informatics: computer simulation , 2002, Comput. Biol. Medicine.

[62]  N L Jain,et al.  Respiratory Isolation of Tuberculosis Patients Using Clinical Guidelines and an Automated Clinical Decision Support System , 1998, Infection Control & Hospital Epidemiology.

[63]  Zafar Iqbal,et al.  Clinical effectiveness: the potential for change in maternity care , 1998 .

[64]  David Mant,et al.  Can randomised trials inform clinical decisions about individual patients? , 1999, The Lancet.

[65]  Alan H. Morris,et al.  Efficacy of computerized decision support for mechanical ventilation: results of a prospective multi-center randomized trial , 1999, AMIA.

[66]  D. Slawson,et al.  What clinical information do doctors need? , 1997 .

[67]  K. Dennis,et al.  Point of care technology: impact on people and paperwork. , 1993, Nursing economic$.

[68]  F D Hobbs,et al.  Primary care anticoagulant clinic management using computerized decision support and near patient International Normalized Ratio (INR) testing: routine data from a practice nurse-led clinic. , 1998, Family practice.

[69]  T Sheldon,et al.  Promoting health care quality: what role performance indicators? , 1998, Quality in health care : QHC.

[70]  Heath K. Frankel,et al.  Automated attention flags in chronic disease care planning , 2001, The Medical journal of Australia.

[71]  I Purves,et al.  Testing of PRODIGY continues , 1998, BMJ.

[72]  R W Evans A critical perspective on the tools to support clinical decision making , 1996, Transfusion.

[73]  M. Monane,et al.  Improving prescribing patterns for the elderly through an online drug utilization review intervention: a system linking the physician, pharmacist, and computer. , 1998, JAMA.

[74]  David L. Schriger,et al.  Implementation of clinical guidelines through an electronic medical record: physician usage, satisfaction and assessment , 2001, Int. J. Medical Informatics.

[75]  David W. Bates,et al.  Comparison of Time Spent Writing Orders on Paper with Computerized Physician Order Entry , 2001, MedInfo.

[76]  D. Bates,et al.  Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. , 1998, JAMA.

[77]  B Stanberry,et al.  Telemedicine: barriers and opportunities in the 21st century , 2000, Journal of internal medicine.

[78]  M. D. Murray,et al.  Research Paper: Effects of Computer-based Prescribing on Pharmacist Work Patterns , 1998, J. Am. Medical Informatics Assoc..

[79]  M. Stefanelli Knowledge Management to Support Performance-based Medicine , 2002, Methods of Information in Medicine.

[80]  J Austoker,et al.  Computer support for interpreting family histories of breast and ovarian cancer in primary care: comparative study with simulated cases , 2000, BMJ : British Medical Journal.

[81]  L Edenbrandt,et al.  Improved classifications of myocardial bull's-eye scintigrams with computer-based decision support system. , 1999, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[82]  N Monaghan Human nature and clinical freedom, barriers to evidence-based practice? , 1999, British dental journal.

[83]  T A Sheldon,et al.  Organisation of asthma care: what difference does it make? A systematic review of the literature. , 1996, Quality in health care : QHC.

[84]  Marc Berg,et al.  Implementing information systems in health care organizations: myths and challenges , 2001, Int. J. Medical Informatics.

[85]  R. Haynes,et al.  Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. , 1998, JAMA.

[86]  J. Parinaud,et al.  A computerized decision support system for ovarian stimulation by gonadotropins. , 2002, Fertility and sterility.

[87]  Nick Freemantle,et al.  Computer support for determining drug dose: systematic review and meta-analysis , 1999, BMJ.

[88]  Rainu Kaushal,et al.  Computerized Physician Order Entry ( CPOE ) with Clinical Decision Support Systems ( CDSSs ) , 2001 .

[89]  J. Holmen,et al.  IMPLEMENTING CLINICAL GUIDELINES IN THE TREATMENT OF DIABETES MELLITUS IN GENERAL PRACTICE , 2000, International Journal of Technology Assessment in Health Care.

[90]  Reed M. Gardner,et al.  Position Paper: Recommendations for Responsible Monitoring and Regulation of Clinical Software Systems , 1997, J. Am. Medical Informatics Assoc..

[91]  P. Ravaud,et al.  A clinical decision support system for prevention of venous thromboembolism: effect on physician behavior. , 2000, JAMA.

[92]  J. Eisenberg,et al.  Ten lessons for evidence-based technology assessment. , 1999, JAMA.

[93]  E P Armstrong,et al.  How pharmacists respond to on-line, real-time DUR alerts. , 1998, Journal of the American Pharmaceutical Association.

[94]  M. Peterson,et al.  Evaluation of an Internet-based Decision-support System for Applying the ATS/CDC Guidelines for Tuberculosis Preventive Therapy , 2000, Medical decision making : an international journal of the Society for Medical Decision Making.

[95]  Lucila Ohno-Machado,et al.  Risk stratification in heart failure using artificial neural networks , 2000, AMIA.

[96]  J D Legler,et al.  Patients' reactions to physician use of a computerized medical record system during clinical encounters. , 1993, The Journal of family practice.

[97]  R. Kaplan,et al.  The balanced scorecard--measures that drive performance. , 2015, Harvard business review.

[98]  J. Wyatt Decision support systems. , 2000, Journal of the Royal Society of Medicine.

[99]  C D Mount,et al.  An integrated electronic health record and information system for Australia? , 2000, The Medical journal of Australia.

[100]  Jenny Field,et al.  General practitioners' perceptions of the route to evidence based medicine: a questionnaire survey , 1998, BMJ.

[101]  G. Browman,et al.  IMPROVING CLINICAL PRACTICE GUIDELINES FOR THE 21ST CENTURY , 2000, International Journal of Technology Assessment in Health Care.

[102]  Gustavo Stubrich The Fifth Discipline: The Art and Practice of the Learning Organization , 1993 .

[103]  V Jirapaet A computer expert system prototype for mechanically ventilated neonates development and impact on clinical judgment and information access capability of nurses. , 2001, Computers in nursing.

[104]  Eta S. Berner,et al.  Effects of a decision support system on physicians' diagnostic performance. , 1999, Journal of the American Medical Informatics Association : JAMIA.

[105]  G. Cumani,et al.  Efficient machine-code test-program induction , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[106]  R. Haux,et al.  A Randomized Evaluation of a Computer-Based Nursing Documentation System , 2001, Methods of Information in Medicine.

[107]  Deborah D. Navedo,et al.  A Guideline Implementation System Using Handheld Computers for Office Management of Asthma: Effects on Adherence and Patient Outcomes , 2000, Pediatrics.

[108]  Steven H. Brown,et al.  RADARx: Recognizing, Assessing, and Documenting Adverse Rx events , 2000, AMIA.

[109]  H B Slotnick,et al.  Physicians' learning strategies. , 2000, Chest.

[110]  P. F. Middleton,et al.  General practitioners' use of evidence databases , 1999, The Medical journal of Australia.

[111]  J. van der Lei,et al.  Compliance of general practitioners with a guideline-based decision support system for ordering blood tests. , 2002, Clinical chemistry.

[112]  R. Nahm,et al.  Measurement of the effects of an integrated, point-of-care computer system on quality of nursing documentation and patient satisfaction. , 2000, Computers in nursing.

[113]  T. Massaro Introducing Physician Order Entry at a Major Academic Medical Center: I. Impact on Organizational Culture and Behavior , 1993, Academic medicine : journal of the Association of American Medical Colleges.

[114]  J. Marc Overhage,et al.  Research Paper: A Randomized Trial of "Corollary Orders" to Prevent Errors of Omission , 1997, J. Am. Medical Informatics Assoc..

[115]  Reed M. Gardner,et al.  Clinicians' Response to Computerized Detection of Infections , 1998, AMIA.

[116]  T D New,et al.  Clinical decision support tools in A&E nursing: a preliminary study. , 2000, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[117]  Daniel Geist,et al.  AVPGEN-A test generator for architecture verification , 1995, IEEE Trans. Very Large Scale Integr. Syst..

[118]  Tim Dornan,et al.  Involving users in the design and usability evaluation of a clinical decision support system , 2002, Comput. Methods Programs Biomed..

[119]  Jonathan M. Teich,et al.  Improving allergy alerting in a computerized physician order entry system , 2000, AMIA.

[120]  David C Classen,et al.  Evaluation of a Computer-Assisted Antibiotic-Dose Monitor , 1999, The Annals of pharmacotherapy.

[121]  T. Brennan,et al.  Costs of medical injuries in Utah and Colorado. , 1999, Inquiry : a journal of medical care organization, provision and financing.

[122]  M Persson,et al.  Evaluation of a computer‐based decision support system for treatment of hypertension with drugs: retrospective, nonintervention testing of cost and guideline adherence , 2000, Journal of internal medicine.

[123]  W. Hammond,et al.  Computerized decision support based on a clinical practice guideline improves compliance with care standards. , 1997, The American journal of medicine.

[124]  S. Pestotnik,et al.  Antibiotic use and microbial resistance in intensive care units: impact of computer-assisted decision support. , 1999, Journal of chemotherapy.

[125]  N. Laird,et al.  Incidence of Adverse Drug Events and Potential Adverse Drug Events: Implications for Prevention , 1995 .

[126]  D. Mungall,et al.  A prospective randomized comparison of the accuracy of computer‐assisted versus GUSTO nomogram‐directed heparin therapy , 1994, Clinical pharmacology and therapeutics.

[127]  C. Silagy,et al.  Trials of providing costing information to general practitioners: a systematic review , 1997, The Medical journal of Australia.

[128]  Gina Pugliese,et al.  Reducing Vancomycin Use Utilizing a Computer Guideline , 1999, Infection Control & Hospital Epidemiology.

[129]  R. Hanka,et al.  Evaluating information technology in health care: barriers and challenges , 1998, BMJ.

[130]  D. Bates,et al.  Effects of computerized physician order entry on prescribing practices. , 2000, Archives of internal medicine.

[131]  Cornelia M. Ruland,et al.  Research Paper: Handheld Technology to Improve Patient Care: Evaluating a Support System for Preference-based Care Planning at the Bedside , 2002, J. Am. Medical Informatics Assoc..

[132]  K Irjala,et al.  Reminders of drug effects on laboratory test results. , 2000, Clinical chemistry.

[133]  Jeremy C Wyatt,et al.  Opportunities for and challenges of computerisation , 1998, The Lancet.

[134]  J H van Bemmel,et al.  Assessment of Decision Support for Blood Test Ordering in Primary Care , 2001, Annals of Internal Medicine.

[135]  M. Peterson,et al.  Evaluation of Internet-Based Clinical Decision Support Systems , 1999, Journal of medical Internet research.

[136]  D. Mazza,et al.  Clinical practice guidelines and the computer on your desk , 2000, The Medical journal of Australia.

[137]  C. Marano,et al.  To err is human. Building a safer health system , 2005 .

[138]  R. Brian Haynes,et al.  Using old technology to implement modern computer-aided decision support for primary diabetes care , 2001, AMIA.

[139]  S Dawson Inhabiting different worlds: how can research relate to practice? , 1997, Quality in health care : QHC.

[140]  Frank F. Land,et al.  Evaluating investments in IT , 1992, J. Inf. Technol..

[141]  Aharon Aharon,et al.  Verification of the IBM RISC System/6000 by a Dynamic Biased Pseudo-Random Test Program Generator , 1991, IBM Syst. J..