Comparing the EvoStreets Visualization Technique in Two-and Three-Dimensional Environments A Controlled Experiment

Analyzing and maintaining large software systems is a challenging task due to the sheer amount of information contained therein. To overcome this problem, Steinbrückner developed a visualization technique named EvoStreets. Utilizing the city metaphor, EvoStreets are well suited to visualize the hierarchical structure of a software as well as hotspots regarding certain aspects. Early implementations of this approach use three-dimensional rendering on regular two-dimensional displays. Recently, though, researchers have begun to visualize EvoStreets in virtual reality using head-mounted displays, claiming that this environment enhances user experience. Yet, there is little research on comparing the differences of EvoStreets visualized in virtual reality with EvoStreets visualized in conventional environments. This paper presents a controlled experiment, involving 34 participants, in which we compared the EvoStreet visualization technique in different environments, namely, orthographic projection with keyboard and mouse, 2.5D projection with keyboard and mouse, and virtual reality with head-mounted displays and hand-held controllers. Using these environments, the participants had to analyze existing Java systems regarding software clones. According to our results, it cannot be assumed that: 1) the orthographic environment takes less time to find an answer, 2) the 2.5D and virtual reality environments provide better results regarding the correctness of edge-related tasks compared to the orthographic environment, and 3) the performance regarding time and correctness differs between the 2.5D and virtual reality environments.

[1]  Jack M. Loomis,et al.  Locomotion Mode Affects the Updating of Objects Encountered During Travel: The Contribution of Vestibular and Proprioceptive Inputs to Path Integration , 1998, Presence.

[2]  P Péruch,et al.  Homing in Virtual Environments: Effects of Field of View and Path Layout , 1997, Perception.

[3]  Pavol Návrat,et al.  VR City: Software Analysis in Virtual Reality Environment , 2017, 2017 IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C).

[4]  Ulrich W. Eisenecker,et al.  GETAVIZ: Generating Structural, Behavioral, and Evolutionary Views of Software Systems for Empirical Evaluation , 2017, 2017 IEEE Working Conference on Software Visualization (VISSOFT).

[5]  Thomas B. Moeslund,et al.  A Procedure for Developing Intuitive and Ergonomic Gesture Interfaces for HCI , 2003, Gesture Workshop.

[6]  Frank Steinbrückner.  Consistent Software Cities: supporting comprehension of evolving software systems , 2012 .

[7]  R. Wang.  Between reality and imagination: When is spatial updating automatic? , 2004, Perception & psychophysics.

[8]  Roy A. Ruddle,et al.  Navigating Large-Scale Virtual Environments: What Differences Occur Between Helmet-Mounted and Desk-Top Displays? , 1999, Presence: Teleoperators & Virtual Environments.

[9]  Jason Leigh,et al.  Visualizing object-oriented software in virtual reality , 2001, Proceedings 9th International Workshop on Program Comprehension. IWPC 2001.

[10]  Rainer Koschke,et al.  What do we need to know about clones? deriving information needs from user goals , 2015, 2015 IEEE 9th International Workshop on Software Clones (IWSC).

[11]  Michele Lanza,et al.  Visualizing Software Systems as Cities , 2007, 2007 4th IEEE International Workshop on Visualizing Software for Understanding and Analysis.

[12]  Michele Lanza,et al.  CodeCity: 3D visualization of large-scale software , 2008, ICSE Companion '08.

[13]  Richard W. Vuduc,et al.  Communicating Software Architecture using a Unified Single-View Visualization , 2007, 12th IEEE International Conference on Engineering Complex Computer Systems (ICECCS 2007).

[14]  Manoel G. Mendonça,et al.  Software evolution visualization: A systematic mapping study , 2013, Inf. Softw. Technol..

[15]  Danny Holten,et al.  Hierarchical Edge Bundles: Visualization of Adjacency Relations in Hierarchical Data , 2006, IEEE Transactions on Visualization and Computer Graphics.

[16]  Mark R. Mine,et al.  Virtual Environment Interaction Techniques , 1995 .

[17]  Samuel S. Silva,et al.  Head-mounted display versus desktop for 3D navigation in virtual reality: a user study , 2008, Multimedia Tools and Applications.

[18]  Yaser Ghanam,et al.  A Survey Paper on Software Architecture Visualization , 2008 .

[19]  Ben Shneiderman,et al.  Tree-maps: a space-filling approach to the visualization of hierarchical information structures , 1991, Proceeding Visualization '91.

[20]  Cláudia Maria Lima Werner,et al.  Dynamic Analysis of Software Systems through Virtual Reality , 2017, 2017 19th Symposium on Virtual and Augmented Reality (SVR).

[21]  Rudolf K. Keller,et al.  A Qualitative and Quantitative Evaluation of Software Visualization Tools , 2001 .

[22]  Stephan Diehl,et al.  Software Visualization - Visualizing the Structure, Behaviour, and Evolution of Software , 2007 .

[23]  Doug A. Bowman,et al.  Maintaining Spatial Orientation during Travel in an Immersive Virtual Environment , 1999, Presence.

[24]  Matjaz Kljun,et al.  The effect of animated transitions on user navigation in 3D tree-maps , 2005, Ninth International Conference on Information Visualisation (IV'05).

[25]  Andreas Schreiber,et al.  Interactive Visualization of Software Components with Virtual Reality Headsets , 2017, 2017 IEEE Working Conference on Software Visualization (VISSOFT).

[26]  Lennart E. Nacke,et al.  Gameplay experience in a gaze interaction game , 2010, ArXiv.

[27]  Takashi Ishio,et al.  Using High-Rising Cities to Visualize Performance in Real-Time , 2017, 2017 IEEE Working Conference on Software Visualization (VISSOFT).

[28]  Mohammad Ghafari,et al.  On the Impact of the Medium in the Effectiveness of 3D Software Visualizations , 2017, 2017 IEEE Working Conference on Software Visualization (VISSOFT).

[29]  John C. Grundy,et al.  A 3D metaphor for software production visualization , 2003, Proceedings on Seventh International Conference on Information Visualization, 2003. IV 2003..

[30]  Marcelo R. Campo,et al.  An Overview of 3D Software Visualization , 2009, IEEE Transactions on Visualization and Computer Graphics.

[31]  Patrick Péruch,et al.  Spatial Orientation in Virtual Environments: Background Considerations and Experiments , 1998, Spatial Cognition.

[32]  Richard Wettel,et al.  Software Systems as Cities , 2010 .

[33]  CPPParser Noa,et al.  Visual Exploration of Large-Scale System Evolution , 2008 .

[34]  Yepeng Guan,et al.  Real-time 3D pointing gesture recognition for natural HCI , 2008, 2008 7th World Congress on Intelligent Control and Automation.

[35]  Stephan Diehl.  Software visualization : international seminar, Dagstuhl Castle, Germany, May 20-25, 2001 : revised papers , 2002 .

[36]  Chanchal Kumar Roy,et al.  The vision of software clone management: Past, present, and future (Keynote paper) , 2014, 2014 Software Evolution Week - IEEE Conference on Software Maintenance, Reengineering, and Reverse Engineering (CSMR-WCRE).

[37]  Malcolm Munro,et al.  Virtual but visible software , 2000, 2000 IEEE Conference on Information Visualization. An International Conference on Computer Visualization and Graphics.

[38]  Wilhelm Hasselbring,et al.  Exploring software cities in virtual reality , 2015, 2015 IEEE 3rd Working Conference on Software Visualization (VISSOFT).

[39]  Rainer Koschke,et al.  A survey on goal-oriented visualization of clone data , 2015, 2015 IEEE 3rd Working Conference on Software Visualization (VISSOFT).

[40]  Olivier Zendra,et al.  Visualization of the Static Aspects of Software: A Survey , 2011, IEEE Transactions on Visualization and Computer Graphics.

[41]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[42]  Rainer Koschke,et al.  A Controlled Experiment on Spatial Orientation in VR-Based Software Cities , 2018, 2018 IEEE Working Conference on Software Visualization (VISSOFT).

[43]  Chris Parnin,et al.  Virtual Reality in Software Engineering: Affordances, Applications, and Challenges , 2015, 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering.

[44]  Wayne L. Shebilske,et al.  Virtual Reality: An Instructional Medium for Visual-Spatial Tasks. , 1992 .

[45]  Roy A. Ruddle,et al.  Effects of proprioceptive feedback and environmental characteristics on spatial learning in virtual environments , 2004, Int. J. Hum. Comput. Stud..

[46]  H. Bülthoff,et al.  Spatial updating in virtual reality: the sufficiency of visual information , 2007, Psychological research.

[47]  Doug A. Bowman,et al.  Evaluating Display Fidelity and Interaction Fidelity in a Virtual Reality Game , 2012, IEEE Transactions on Visualization and Computer Graphics.

[48]  Chris Parnin,et al.  A catalogue of lightweight visualizations to support code smell inspection , 2008, SOFTVIS.

[49]  Michael Balzer,et al.  Voronoi treemaps for the visualization of software metrics , 2005, SoftVis '05.

[50]  Giuseppe Scanniello,et al.  Visualising a Software System as a City Through Virtual Reality , 2017, AVR.

[51]  Rainer Koschke,et al.  Journal of Software Maintenance and Evolution: Research and Practice Software Visualization in Software Maintenance, Reverse Engineering, and Re-engineering: a Research Survey , 2022 .

[52]  Joseph J. LaViola,et al.  Code Park: A New 3D Code Visualization Tool , 2017, 2017 IEEE Working Conference on Software Visualization (VISSOFT).