Using enterprise architecture analysis and interview data to estimate service response time

Insights into service response time is important for service-oriented architectures and service management. However, directly measuring the service response time is not always feasible or can be very costly. This paper extends an analytical modeling method which uses enterprise architecture modeling to support the analysis. The extensions consist of (i) a formalization using the Hybrid Probabilistic Relational Model formalism, (ii) an implementation in an analysis tool for enterprise architecture and (iii) a data collection approach using expert assessments collected via interviews and questionnaires. The accuracy and cost effectiveness of the method was tested empirically by comparing it with direct performance measurements of five services of a geographical information system at a Swedish utility company. The tests indicate that the proposed method can be a viable option for rapid service response time estimates when a moderate accuracy within 15% is sufficient.

[1]  Robert Lagerström,et al.  A method for creating entreprise architecture metamodels applied to systems modifiability , 2009, Int. J. Comput. Sci. Appl..

[2]  Peter Buchholz,et al.  A class of hierarchical queueing networks and their analysis , 1994, Queueing Syst. Theory Appl..

[3]  Michael Rosemann,et al.  Identification and Analysis of Business and Software Services—A Consolidated Approach , 2009, IEEE Transactions on Services Computing.

[4]  Maria-Eugenia Iacob,et al.  Quantitative Analysis of Enterprise Architectures , 2006 .

[5]  Jeffrey P. Buzen,et al.  Fundamental operational laws of computer system performance , 1976, Acta Informatica.

[6]  Quan Z. Sheng,et al.  Quality driven web services composition , 2003, WWW '03.

[7]  Thomas Lambolais,et al.  UML extensions for the specification and evaluation of latency constraints in architectural models , 2000, WOSP '00.

[8]  John Leaney,et al.  The ABACUS architectural approach to computer-based system and enterprise evolution , 2005, 12th IEEE International Conference and Workshops on the Engineering of Computer-Based Systems (ECBS'05).

[9]  Virgílio A. F. Almeida,et al.  Resource Management in the Autonomic Service-Oriented Architecture , 2006, 2006 IEEE International Conference on Autonomic Computing.

[10]  Mathias Ekstedt,et al.  A probabilistic relational model for security risk analysis , 2010, Comput. Secur..

[11]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[12]  Omar El Sawy,et al.  Building an Information System Design Theory for Vigilant EIS , 1992, Inf. Syst. Res..

[13]  Moustafa Chenine,et al.  Enterprise Architecture Analysis for Data Accuracy Assessments , 2009, 2009 IEEE International Enterprise Distributed Object Computing Conference.

[14]  Gwo-Guang Lee,et al.  Customer perceptions of e‐service quality in online shopping , 2005 .

[15]  Rick Kazman,et al.  Evaluating Software Architectures: Methods and Case Studies , 2001 .

[16]  Ralf H. Reussner,et al.  Reliability prediction for component-based software architectures , 2003, J. Syst. Softw..

[17]  Kalle Lyytinen,et al.  Building Enterprise Architecture Agility and Sustenance with SOA , 2008, Communications of the Association for Information Systems.

[18]  Barry W. Boehm,et al.  Software development cost estimation approaches — A survey , 2000, Ann. Softw. Eng..

[19]  Peter Byass,et al.  Moving from Data on Deaths to Public Health Policy in Agincourt, South Africa: Approaches to Analysing and Understanding Verbal Autopsy Findings , 2010, PLoS medicine.

[20]  Jeremy E. Oakley,et al.  Uncertain Judgements: Eliciting Experts' Probabilities , 2006 .

[21]  S. Lauritzen.  Propagation of Probabilities, Means, and Variances in Mixed Graphical Association Models , 1992 .

[22]  Anil B. Jambekar.  A systems thinking perspective of maintenance, operations, and process quality , 2000 .

[23]  Gary Klein,et al.  Measuring Information System Service Quality: SERVQUAL from the Other Side , 2002, MIS Q..

[24]  Thomas Erl,et al.  Service-Oriented Architecture: Concepts, Technology, and Design , 2005 .

[25]  Narasimhaiah Gorla,et al.  Organizational impact of system quality, information quality, and service quality , 2010, J. Strateg. Inf. Syst..

[26]  Changhe Yuan,et al.  Importance Sampling for General Hybrid Bayesian Networks , 2007, AISTATS.

[27]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[28]  Markus Buschle,et al.  A Tool for Enterprise Architecture Analysis using the PRM formalism , 2010, CAiSE Forum.

[29]  J. Little.  A Proof for the Queuing Formula: L = λW , 1961 .

[30]  A. Parasuraman,et al.  A Conceptual Model of Service Quality and Its Implications for Future Research , 1985 .

[31]  W.M.P. van der Aalst,et al.  Business process redesign: a Petri-net-based approach , 1996 .

[32]  Joseph M. Mellichamp,et al.  Software Development Cost Estimation Using Function Points , 1994, IEEE Trans. Software Eng..

[33]  Luke Y.-C. Lien,et al.  A tree convolution algorithm for the solution of queueing networks , 1983, CACM.

[34]  Ayed Alwadain,et al.  Integrating SOA into an enterprise architecture - A comparative analysis of alternative approaches , 2010 .

[35]  Shirley Gregor,et al.  The Anatomy of a Design Theory , 2007, J. Assoc. Inf. Syst..

[36]  Raj Jain,et al.  The art of computer systems performance analysis - techniques for experimental design, measurement, simulation, and modeling , 1991, Wiley professional computing.

[37]  Robert Lagerström,et al.  A Framework for Service Interoperability Analysis using Enterprise Architecture Models , 2008, 2008 IEEE International Conference on Services Computing.

[38]  Jonathan W. Palmer,et al.  Web Site Usability, Design, and Performance Metrics , 2002, Inf. Syst. Res..

[39]  Rainer Alt,et al.  Business-Driven Service Modelling - A Methodological Approach from the Finance Industry , 2007, BPSC.

[40]  Philip S. Yu,et al.  Utility computing SLA management based upon business objectives , 2004, IBM Syst. J..

[41]  Helmut Krcmar,et al.  Quality aspects in service ecosystems: areas for exploitation and exploration , 2008, ICEC.

[42]  Philip E. T. Lewis,et al.  Research Methods for Business Students , 2006 .

[43]  Helmut Krcmar,et al.  Quality management in service ecosystems , 2009, Inf. Syst. E Bus. Manag..

[44]  Markus Buschle,et al.  Hybrid Probabilistic Relational Models for System Quality Analysis , 2010, 2010 14th IEEE International Enterprise Distributed Object Computing Conference.

[45]  Kjetil Moløkken-Østvold,et al.  Using planning poker for combining expert estimates in software projects , 2008, J. Syst. Softw..

[46]  Fatemeh Zahedi,et al.  Reliability metric for information systems based on customer requirements , 1997 .

[47]  Jeffrey P. Buzen,et al.  Computational algorithms for closed queueing networks with exponential servers , 1973, Commun. ACM.

[48]  Frank Leymann,et al.  Web services and business process management , 2002, IBM Syst. J..

[49]  Lise Getoor,et al.  Learning Probabilistic Relational Models , 1999, IJCAI.

[50]  Steffen Becker,et al.  The Palladio component model for model-driven performance prediction , 2009, J. Syst. Softw..

[51]  Sébastien Gérard,et al.  First Experiments Using the UML Profile for MARTE , 2008, 2008 11th IEEE International Symposium on Object and Component-Oriented Real-Time Distributed Computing (ISORC).

[52]  Mathias Ekstedt,et al.  Data Collection Prioritization for System Quality Analysis , 2009, Electron. Notes Theor. Comput. Sci..

[53]  Mathias Ekstedt,et al.  Assessment of Enterprise Information Security — The Importance of Information Search Cost , 2006, Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06).

[54]  Robert Winter,et al.  Essential Layers, Artifacts, and Dependencies of Enterprise Architecture , 2006, 2006 10th IEEE International Enterprise Distributed Object Computing Conference Workshops (EDOCW'06).

[55]  Moustafa Chenine,et al.  Data accuracy assessment using enterprise architecture , 2011, Enterp. Inf. Syst..

[56]  Claus-Peter Präg,et al.  IT-Service Cachet - Managing IT-Service Performance and IT-Service Quality , 2006, HICSS.

[57]  Stephen S. Lavenberg,et al.  Mean-Value Analysis of Closed Multichain Queuing Networks , 1980, JACM.

[58]  Jeanne W. Ross,et al.  Enterprise Architecture As Strategy: Creating a Foundation for Business Execution , 2006 .

[59]  Connie U. Smith,et al.  New Book - Performance Solutions: A Practical Guide to Creating Responsive, Scalable Software , 2001, Int. CMG Conference.

[60]  Mike P. Papazoglou,et al.  Service-oriented design and development methodology , 2006, Int. J. Web Eng. Technol..

[61]  Karl Cox,et al.  Empirical study of Sommerville and Sawyer's requirements engineering practices , 2009, IET Softw..

[62]  Marc M. Lankhorst,et al.  Enterprise Architecture at Work - Modelling, Communication and Analysis, 2nd Edition , 2005, The Enterprise Engineering Series.

[63]  Stephan Aier,et al.  Deriving SOA Evaluation Metrics in an Enterprise Architecture Context , 2009, ICSOC Workshops.

[64]  Peter G. Harrison,et al.  Performance modelling of communication networks and computer architectures , 1992, International computer science series.

[65]  Arnold O. Allen,et al.  Probability, statistics and queueing theory - with computer science applications (2. ed.) , 1981, Int. CMG Conference.

[66]  Rick Kazman,et al.  From Software Architecture Analysis to Service Engineering: An Empirical Study of Methodology Development for Enterprise SOA Implementation , 2010, IEEE Transactions on Services Computing.

[67]  K. Suzanne Barber,et al.  Enabling iterative software architecture derivation using early non-functional property evaluation , 2002, Proceedings 17th IEEE International Conference on Automated Software Engineering,.

[68]  Robert Winter,et al.  Integration of IT service management into enterprise architecture , 2007, SAC '07.

[69]  Wil M. P. van der Aalst,et al.  Workflow Patterns , 2004, Distributed and Parallel Databases.

[70]  Gero Mühl,et al.  QoS aggregation for Web service composition using workflow patterns , 2004 .

[71]  R. Cooke.  Experts in Uncertainty: Opinion and Subjective Probability in Science , 1991 .

[72]  Salvatore T. March,et al.  Design and natural science research on information technology , 1995, Decis. Support Syst..

[73]  A. Parasuraman,et al.  Service quality delivery through web sites: A critical review of extant knowledge , 2002, Journal of the Academy of Marketing Science.

[74]  Xin Wang,et al.  From UML Descriptions of High-Level Software Architectures to LQN Performance Models , 1999, AGTIVE.