Proceso de agregación con múltiples niveles de evidencia para estudios experimentales en Ingeniería del Software

Current process’ of aggregation of result about experimental studies, based on meta analysis from other sciences, showed that they are not suitable for software engineering. This article adds an alternative aggregation process to the standard one, based on an aggregation strategy with multiple levels of evidence; in which each level is connected with a specific aggregation technique that is assigned considering the quality and quantity of experimental studies identified.

[1]  Xiao-Hua Zhou,et al.  Statistical Methods for Meta‐Analysis , 2008 .

[2]  Reidar Conradi,et al.  A Review of Studies on Expert Estimation of Software Development Effort , 2006 .

[3]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[4]  Nigel Shadbolt,et al.  The efficacy of knowledge elicitation techniques: a comparison across domains and levels of expertise , 1990 .

[5]  David DeMatteo,et al.  Essentials of research design and methodology , 2005 .

[6]  M. Forbes,et al.  Variable reporting and quantitative reviews: a comparison of three meta‐analytical techniques , 2003 .

[7]  Nigel Shadbolt,et al.  A formal evaluation of knowledge elicitation techniques for expert systems: domain 1 , 1988 .

[8]  Barbara A. Kitchenham,et al.  Combining empirical results in software engineering , 1998, Inf. Softw. Technol..

[9]  Ritu Agarwal,et al.  Knowledge Acquisition Using Structured Interviewing: An Empirical Investigation , 1990, J. Manag. Inf. Syst..

[10]  David B. Pillemer,et al.  Synthesizing Outcomes: How to Use Research Evidence from Many Studies. , 1980 .

[11]  R. Yin,et al.  Using the Case Survey Method To Analyze Policy Studies. , 1975 .

[12]  H. Hricak,et al.  Evidence-based medicine. , 1997, Singapore medical journal.

[13]  Sarkis Meterissian,et al.  Canadian Association of General Surgeons and American College of Surgeons Evidence Based Reviews in Surgery. 23. ASCO recommended guidelines for sentinel lymph node biopsy for early-stage breast cancer. Evidence-based medicine. A new approach to teaching the practice of medicine. , 2007, Canadian journal of surgery. Journal canadien de chirurgie.

[14]  G. Noblit,et al.  Meta-Ethnography: Synthesizing Qualitative Studies , 1988 .

[15]  Claes Wohlin,et al.  Combining Data from Reading Experiments in Software Inspections: A Feasibility Study , 2003, Lecture Notes on Empirical Software Engineering.

[16]  Alan Bundy,et al.  Proceedings of Expert Systems '87 on Research and Development in Expert Systems IV , 1987 .

[17]  Rajiv D. Banker,et al.  Scale Economies in New Software Development , 2013, IEEE Transactions on Software Engineering.

[18]  W. Thalheimer,et al.  How to calculate effect sizes from published research: A simplified methodology , 2002 .

[19]  Nigel Shadbolt,et al.  Comparing knowledge elicitation techniques: a case study , 2004, Artificial Intelligence Review.

[20]  Qing Hu.  Evaluating Alternative Software Production Functions , 1997, IEEE Trans. Software Eng..

[21]  Reidar Conradi,et al.  Vote-Counting for Combining Quantitative Evidence from Empirical Studies- An Example , 2006 .

[22]  Jeffrey C. Carver,et al.  Replicated Studies: Building a Body of Knowledge about Software Reading Techniques , 2003, Lecture Notes on Empirical Software Engineering.

[23]  Magne Jørgensen,et al.  A review of studies on expert estimation of software development effort , 2004, J. Syst. Softw..

[24]  Natalia Juristo Juzgado,et al.  Effectiveness of Requirements Elicitation Techniques: Empirical Results Derived from a Systematic Review , 2006, 14th IEEE International Requirements Engineering Conference (RE'06).

[25]  James Miller,et al.  Applying meta-analytical procedures to software engineering experiments , 2000, J. Syst. Softw..

[26]  Moody W. Janette.  Enhancing knowledge elicitation using the cognitive interview , 1996 .

[27]  Beth Crandall,et al.  A comparative study of think-aloud and critical decision knowledge elicitation methods , 1989, SGAR.

[28]  Natalia Juristo Juzgado,et al.  Reviewing 25 Years of Testing Technique Experiments , 2004, Empirical Software Engineering.

[29]  Miguel P Caldas,et al.  Research design: qualitative, quantitative, and mixed methods approaches , 2003 .

[30]  S. O’Meara,et al.  A systematic review to evaluate the effectiveness of interventions to promote the initiation of breastfeeding. , 2000, Health technology assessment.

[31]  Barbara Kitchenham,et al.  Procedures for Performing Systematic Reviews , 2004 .

[32]  Mary Dixon-Woods,et al.  Synthesising qualitative and quantitative evidence: a review of possible methods. , 2005, Journal of health services research & policy.

[33]  Robert W. Zmud,et al.  The Use of Mental Imagery to Facilitate Information Identification in Requirements Analysis , 1993, J. Manag. Inf. Syst..

[34]  A. Detsky,et al.  Evidence-based medicine. A new approach to teaching the practice of medicine. , 1992, JAMA.

[35]  L. Hedges,et al.  Meta-analysis: Combining the results of independent experiments , 1993 .