Using Visualization and Text Mining to Improve Qualitative Analysis

Context: Qualitative analysis is a scientific way to deeply understand qualitative data and to aid in its analysis. However, qualitative analysis is a laborious, time-consuming and subjective process. Aim: The authors propose the use of visualization and text mining to improve the qualitative analysis process. The objective of this paper is to explain how the use of visualization can support the Coding in multiple documents simultaneously, which may allow codes standardization thus making the process more efficient. Method: The Insight tool is being developed to make the proposal feasible and a feasibility study was performed to verify if the proposal offers benefits to the process and improves its results. Results: The study shows that the subjects who applied the proposal got more standardized codes and were more efficient than the ones who applied the process manually. Conclusions: The results derived from the use of visualization and text mining, even in a feasibility study, encourage proceeding with the project, which aims to combine both techniques to obtain more benefits on qualitative analysis conduction.

[1]  Carolyn B. Seaman,et al.  Qualitative Methods in Empirical Studies of Software Engineering , 1999, IEEE Trans. Software Eng..

[2]  Patricia Lago,et al.  Exploring service-oriented system engineering challenges: a systematic literature review , 2009, Service Oriented Computing and Applications.

[3]  Ronen Feldman,et al.  The Text Mining Handbook: Index , 2006 .

[4]  Jeffrey C. Carver,et al.  An empirical methodology for introducing software processes , 2001, ESEC/FSE-9.

[5]  Forrest Shull,et al.  Packaging Researcher Experience to Assist Replication of Experiments , 1996 .

[6]  Rory V. O'Connor,et al.  Using grounded theory to understand software process improvement: A study of Irish software product companies , 2007, Inf. Softw. Technol..

[7]  Dietmar Pfahl,et al.  Reporting guidelines for controlled experiments in software engineering , 2005, 2005 International Symposium on Empirical Software Engineering, 2005..

[8]  James Allan,et al.  Text retrieval using the vector processing model , 1994 .

[9]  Ben Shneiderman,et al.  Tree-maps: a space-filling approach to the visualization of hierarchical information structures , 1991, Proceeding Visualization '91.

[10]  J. Hart [Qualitative methods]. , 2000, Recherche en soins infirmiers.

[11]  Daniela Cruzes,et al.  Recommended Steps for Thematic Synthesis in Software Engineering , 2011, 2011 International Symposium on Empirical Software Engineering and Measurement.

[12]  N. Hoffart Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory , 2000 .