Ranking open source application integration frameworks based on maintainability metrics: A review of five‐year evolution

Integration frameworks are specialized software tools built and adapted to facilitate the design and implementation of integration solutions. An integration solution allows for the reuse of applications from the software ecosystem of companies to support their business processes. There are several open‐source integration frameworks available on the market designed to operate in a business context to manipulate structured data; however, increasingly, they are required to deal with unstructured and large volumes of data, thus requiring effort to adapt these frameworks to work with unstructured and large volume of data. Choosing the framework, which is the easiest to be adapted, is not a trivial task. In this article, we review the newest stable versions of four open‐source integration frameworks by analyzing how they have evolved regarding their adaptive maintainability over five years. We rank them according to their maintainability degree and compare past and current versions of each framework. To encourage and enable researchers and developers to replicate our experiments, with the aim of verifying our findings, and to experiment with new versions of the integration frameworks analyzed, we detail the experimental protocol used while also having made all the required software involved available on the Web.

[1]  Aruna Raja,et al.  Domain Specific Languages , 2010 .

[2]  Massimo Pezzini,et al.  Magic Quadrant for Enterprise Integration Platform as a Service , 2014 .

[3]  David S. Linthicum Cloud Computing Changes Data Integration Forever: What's Needed Right Now , 2017, IEEE Cloud Computing.

[4]  Konstantinos Manikas,et al.  Revisiting software ecosystems Research: A longitudinal literature study , 2016, J. Syst. Softw..

[5]  Lionel C. Briand,et al.  A Unified Framework for Cohesion Measurement in Object-Oriented Systems , 2004, Empirical Software Engineering.

[6]  Victor Romero,et al.  Mule in Action , 2009 .

[7]  Fabricia Roos-Frantz,et al.  Ranking enterprise application integration platforms from a performance perspective: An experience report , 2019, Softw. Pract. Exp..

[8]  Max Jacobson,et al.  A Pattern Language: Towns, Buildings, Construction , 1981 .

[9]  Rizos Sakellariou,et al.  A characterization of workflow management systems for extreme-scale applications , 2016, Future Gener. Comput. Syst..

[10]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[11]  Ghassan Alkadi,et al.  Application of a Revised DIT Metric to Redesign an OO Design , 2003, J. Object Technol..

[12]  Rodrigo Pereira dos Santos,et al.  A Proposal for Software Ecosystems Engineering , 2011, IWSECO@ICSOB.

[13]  Daniel Izquierdo-Cortazar,et al.  FLOSSMetrics: Free/Libre/Open Source Software Metrics , 2009, 2009 13th European Conference on Software Maintenance and Reengineering.

[14]  Stephen R. Schach,et al.  Common coupling as a measure of reuse effort in kernel-based software with case studies on the creation of MkLinux and Darwin , 2008, Journal of the Brazilian Computer Society.

[15]  Petra Bosch-Sijtsema,et al.  From integration to composition: On the impact of software product lines, global development and ecosystems , 2010, J. Syst. Softw..

[16]  Fabricia Roos-Frantz,et al.  Survey on the run‐time systems of enterprise application integration platforms focusing on performance , 2018, Softw. Pract. Exp..

[17]  Stephen R. Schach,et al.  Quantitatively measuring object-oriented couplings , 2008, Software Quality Journal.

[18]  Lionel C. Briand,et al.  A measurement framework for object-oriented software testability , 2005, Inf. Softw. Technol..

[19]  Mario Piattini,et al.  A Survey of Metrics for UML Class Diagrams , 2005, J. Object Technol..

[20]  Anas N. Al-Rabadi,et al.  A comparison of modified reconstructability analysis and Ashenhurst‐Curtis decomposition of Boolean functions , 2004 .

[21]  Sallie M. Henry,et al.  Object-oriented metrics that predict maintainability , 1993, J. Syst. Softw..

[22]  Wu He,et al.  Integration of Distributed Enterprise Applications: A Survey , 2014, IEEE Transactions on Industrial Informatics.

[23]  Norman May,et al.  Patterns for emerging application integration scenarios: A survey , 2017, Inf. Syst..

[24]  Christoph Bussler,et al.  Enterprise Application Integration , 2005, Encyclopedia of Database Technologies and Applications.

[25]  Chris F. Kemerer,et al.  A Metrics Suite for Object Oriented Design , 2015, IEEE Trans. Software Eng..

[26]  Mark Fisher,et al.  Spring Integration in Action , 2012 .

[27]  Robert C. Martin Agile Software Development, Principles, Patterns, and Practices , 2002 .

[28]  Michele Lanza,et al.  Object-Oriented Metrics in Practice - Using Software Metrics to Characterize, Evaluate, and Improve the Design of Object-Oriented Systems , 2006 .

[29]  Frederick T. Sheldon,et al.  Metrics for maintainability of class inheritance hierarchies , 2002, J. Softw. Maintenance Res. Pract..

[30]  Giuseppe Scanniello,et al.  Metric Attitude , 2013, 2013 17th European Conference on Software Maintenance and Reengineering.

[31]  Stefanie Rinderle-Ma,et al.  Toward Application Integration with Multimedia Data , 2017, 2017 IEEE 21st International Enterprise Distributed Object Computing Conference (EDOC).

[32]  Gregor Hohpe,et al.  Enterprise Integration Patterns: Designing, Building, and Deploying Messaging Solutions , 2003 .

[33]  Mark Lorenz,et al.  Object-oriented software metrics - a practical guide , 1994 .

[34]  Brian Henderson-Sellers,et al.  Object-Oriented Metrics , 1995, TOOLS.

[35]  Nico Ebert,et al.  Integration Platform as a Service , 2017, Bus. Inf. Syst. Eng..

[36]  Rafael Corchuelo,et al.  On the design of a maintainable software development kit to implement integration solutions , 2016, J. Syst. Softw..

[37]  Georgios Lajios Software Metrics Suites for Project Landscapes , 2009, 2009 13th European Conference on Software Maintenance and Reengineering.

[38]  Rafael Corchuelo,et al.  A methodology to evaluate the maintainability of enterprise application integration frameworks , 2015, Int. J. Web Eng. Technol..

[39]  Cesare Pautasso,et al.  A Decade of Enterprise Integration Patterns: A Conversation with the Authors , 2016, IEEE Softw..

[40]  Michael W. Godfrey,et al.  Understanding source package organization using the hybrid model , 2009, 2009 IEEE International Conference on Software Maintenance.

[41]  Radu Marinescu,et al.  Measurement and Quality in Object-Oriented Design , 2005, ICSM.

[42]  Nadine Gottschalk,et al.  Camel In Action , 2016 .