An empirical study assessing the effect of seeit 3D on comprehension

A study to assess the effect of SeeIT 3D, a software visualization tool is presented. Six different tasks in three different task categories are assessed in the context of a large open-source system. Ninety-seven subjects were recruited from three different universities to participate in the study. Two methods of data collection: traditional questionnaires and an eye-tracker were used. The main goal was to determine the impact and added benefit of SeeIT 3D while performing typical software tasks within the Eclipse IDE. Results indicate that SeeIT 3D performs significantly better in one task category namely overview tasks but takes significantly longer when completing bug fixing tasks. Scores obtained by the subjects in the SeeIT 3D group are 13% better and 45% faster for overview tasks.

[1]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[2]  Rudolf K. Keller,et al.  Software visualization tools: survey and analysis , 2001, Proceedings 9th International Workshop on Program Comprehension. IWPC 2001.

[3]  Harry M. Sneed.  Estimating the costs of software maintenance tasks , 1995, Proceedings of International Conference on Software Maintenance.

[4]  Jonathan I. Maletic,et al.  Assessing the Comprehension of UML Class Diagrams via Eye Tracking , 2007, 15th IEEE International Conference on Program Comprehension (ICPC '07).

[5]  Claes Wohlin,et al.  Experimentation in software engineering: an introduction , 2000 .

[6]  Andrian Marcus,et al.  3D representations for software visualization , 2003, SoftVis '03.

[7]  Dawn J. Lawrie,et al.  The impact of identifier style on effort and comprehension , 2012, Empirical Software Engineering.

[8]  Jörg Rech,et al.  Visual support of software engineers during development and maintenance , 2007, SOEN.

[9]  Yann-Gaël Guéhéneuc,et al.  Impact of the visitor pattern on program comprehension and maintenance , 2009, 2009 3rd International Symposium on Empirical Software Engineering and Measurement.

[10]  Olivier Zendra,et al.  Visualization of the Static Aspects of Software: A Survey , 2011, IEEE Transactions on Visualization and Computer Graphics.

[11]  Andrian Marcus,et al.  Comprehension of software analysis data using 3D visualization , 2003, 11th IEEE International Workshop on Program Comprehension, 2003..

[12]  Yann-Gaël Guéhéneuc,et al.  TAUPE: towards understanding program comprehension , 2006, CASCON.

[13]  Rainer Koschke,et al.  Journal of Software Maintenance and Evolution: Research and Practice Software Visualization in Software Maintenance, Reverse Engineering, and Re-engineering: a Research Survey , 2022 .

[14]  Andrian Marcus,et al.  Sv3D meets Eclipse , 2009, 2009 5th IEEE International Workshop on Visualizing Software for Understanding and Analysis.

[15]  Romain Robbes,et al.  Software systems as cities: a controlled experiment , 2011, 2011 33rd International Conference on Software Engineering (ICSE).

[16]  Arie van Deursen,et al.  A Controlled Experiment for Program Comprehension through Trace Visualization , 2011, IEEE Transactions on Software Engineering.

[17]  Yann-Gaël Guéhéneuc,et al.  Women and men — Different but equal: On the impact of identifier style on source code reading , 2012, 2012 20th IEEE International Conference on Program Comprehension (ICPC).

[18]  Jonathan I. Maletic,et al.  An eye tracking study on the effects of layout in understanding the role of design patterns , 2010, 2010 IEEE International Conference on Software Maintenance.

[19]  Jonathan I. Maletic,et al.  On using eye tracking in empirical assessment of software visualizations , 2007, WEASELTech '07.

[20]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[21]  Thomas A. Corbi,et al.  Program Understanding: Challenge for the 1990s , 1989, IBM Syst. J..

[22]  Andrian Marcus,et al.  Source Viewer 3D (sv3D) - a framework for software visualization , 2003, 25th International Conference on Software Engineering, 2003. Proceedings..

[23]  Marcelo R. Campo,et al.  An Overview of 3D Software Visualization , 2009, IEEE Transactions on Visualization and Computer Graphics.

[24]  Andrian Marcus,et al.  Supporting the evolution of a software visualization tool through usability studies , 2005, 13th International Workshop on Program Comprehension (IWPC'05).

[25]  Andrew T. Duchowski,et al.  Eye Tracking Methodology: Theory and Practice , 2003, Springer London.

[26]  Jonathan I. Maletic,et al.  An Eye Tracking Study on camelCase and under_score Identifier Styles , 2010, 2010 IEEE 18th International Conference on Program Comprehension.