Towards a Software Engineering Process for Developing Data-Driven Applications

Machine Learning and Artificial Intelligence allow the development of a new type of applications that automatically identify hidden patterns, process large amounts of data, and classify data according to aforementioned patterns. While they offer interesting solutions for several problems, they also impose challenges on software engineers in charge of structuring the development effort. The new applications require to incorporate additional specialists and their work into an overall development effort. We thus propose a software engineering process for data-driven applications.

[1]  Wei Wang,et al.  Recommender system application developments: A survey , 2015, Decis. Support Syst..

[2]  Volker Gruhn,et al.  Toward a Practical Process Model for Anomaly Detection Systems , 2018, 2018 IEEE/ACM 1st International Workshop on Software Engineering for Cognitive Services (SE4COG).

[3]  Ivar Jacobson,et al.  The Unified Modeling Language User Guide (2nd Edition) , 2015 .

[4]  Anil A. Bharath,et al.  Deep Reinforcement Learning: A Brief Survey , 2017, IEEE Signal Processing Magazine.

[5]  Volker Gruhn,et al.  Engineering Cyber-Physical Systems , 2017, SoMeT.

[6]  Shikha Agrawal,et al.  Survey on Anomaly Detection using Data Mining Techniques , 2015, KES.

[7]  Anthony I. Wasserman,et al.  Software engineering issues for mobile application development , 2010, FoSER '10.

[8]  David H. Wolpert,et al.  The Lack of A Priori Distinctions Between Learning Algorithms , 1996, Neural Computation.

[9]  Padhraic Smyth,et al.  Knowledge Discovery and Data Mining: Towards a Unifying Framework , 1996, KDD.

[10]  Rüdiger Wirth,et al.  CRISP-DM: Towards a Standard Process Model for Data Mining , 2000 .

[11]  Lukasz A. Kurgan,et al.  A survey of Knowledge Discovery and Data Mining process models , 2006, The Knowledge Engineering Review.

[12]  Ivar Jacobson,et al.  Unified Modeling Language User Guide, The (2nd Edition) (Addison-Wesley Object Technology Series) , 2005 .

[13]  Manfred Broy,et al.  Engineering Cyber-Physical Systems: Challenges and Foundations , 2012, CSDM.

[14]  David Maxwell Chickering,et al.  Machine Teaching: A New Paradigm for Building Machine Learning Systems , 2017, ArXiv.

[15]  Pekka Abrahamsson,et al.  Mobile-D: an agile approach for mobile application development , 2004, OOPSLA '04.

[16]  Ernestina Menasalvas Ruiz,et al.  Toward data mining engineering: A software engineering approach , 2009, Inf. Syst..