Improving the real-time experience for software-measurement system end-users

Background: Software measurement systems are used in large companies to provide developers with up-to-date feedback and metrics. Aim /Problem: However, the front-ends of these systems are often not ready to provide a real-time experience for the end-users, who sometimes have to wait minutes before visualizations are provided. Method: In this paper we compare four alternative technological setups for these front-ends that were created within a large international telecommunication provider. We use a publicly available dataset for a performance evaluation and to analyze the results. Results: Our results indicate that the choice of the visualization component has a larger impact on the performance than the choice of the data storage. However, performance is also impacted by the combination of storage and visualization tools used.

[1]  Miroslaw Staron,et al.  Measurement-as-a-Service - A New Way of Organizing Measurement Programs in Large Software Development Companies , 2015, IWSM/Mensura.

[2]  V. Basili.  Software modeling and measurement: the Goal/Question/Metric paradigm , 1992 .

[3]  A. Vargha,et al.  A Critique and Improvement of the CL Common Language Effect Size Statistics of McGraw and Wong , 2000 .

[4]  Robert J. Houghton,et al.  Vigilant Information Systems for Managing Enterprises in Dynamic Supply Chains: Real-Time Dashboards at Western Digital , 2004, MIS Q. Executive.

[5]  Miroslaw Staron,et al.  Ensuring Reliability of Information Provided by Measurement Systems , 2009, IWSM/Mensura.

[6]  Marianne Shaw,et al.  On Improving User Response Times in Tableau , 2015, SIGMOD Conference.

[7]  F. Faita,et al.  Real‐time Measurement System for Evaluation of the Carotid Intima‐Media Thickness With a Robust Edge Operator , 2008, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[8]  Qi Wang,et al.  Ambient Surfaces: Interactive Displays in the Informative Workspace of Co-located Scrum Teams , 2016, NordiCHI.

[9]  Pawel Terlecki,et al.  An analytic data engine for visualization in tableau , 2011, SIGMOD '11.

[10]  Miroslaw Staron,et al.  Developing measurement systems: an industrial case study , 2011, J. Softw. Maintenance Res. Pract..

[11]  Mary Czerwinski,et al.  FASTDash: a visual dashboard for fostering awareness in software teams , 2007, CHI.

[12]  Detlef D. Nauck,et al.  Real Time Business Intelligence for the Adaptive Enterprise , 2006, The 8th IEEE International Conference on E-Commerce Technology and The 3rd IEEE International Conference on Enterprise Computing, E-Commerce, and E-Services (CEC/EEE'06).