Challenges of applying ethnography to study software practices

Ethnography is about the adoption of a cultural lens to observe and interpret events, actions, and behaviors, ensuring that they are placed in a relevant and meaningful context. Using this approach, it is possible to capture and analyze software development practices. Our aims are to illustrate the use of an ethnographic approach in a case study of agile software development adoption, to discuss the methodological challenges involved, and to provide support to others who conduct ethnographic studies of software practice. An ethnographic case study was conducted, employing participant observation, interviews, and document analysis. Difficulties and decisions were recorded and compared with those encountered in the literature. Finally, key challenges and guidelines to tackle them were discussed and documented. We identified five key challenges of applying ethnography to the study of software practices: (a) working in collaboration with and having something to offer to the participating company; (b) the insider/outsider dynamic of participant observation; (c) the balance between participant listening and participant observation; (d) the researcher's relationship with the participants; and (e) the rigor in qualitative work that involves the dilemma of the contextualization to be sufficiently broad and detailed. This study shows that ethnographic methods are indispensible when trying to understand software practice, and that the fundamental challenge for the researcher is to balance the role of participant observer with rigorous fieldwork.

[1]  David M. Fetterman,et al.  Ethnography: Step-by-Step , 1989 .

[2]  Martyn Hammersley,et al.  Ethnography: problems and prospects , 2005 .

[3]  Alexander Boden,et al.  Conducting a Business Ethnography in Global Software Development projects of small German enterprises , 2011, Inf. Softw. Technol..

[4]  Sue J. Waite,et al.  Real world research: a resource for users of social research methods in applied settings (3rd ed.) , 2012 .

[5]  S. Lewis,et al.  Being embedded: A way forward for ethnographic research , 2011 .

[6]  Yvonne Dittrich,et al.  Combining qualitative empirical research with method, technique and process improvement , 2008 .

[7]  Per Runeson,et al.  Guidelines for conducting and reporting case study research in software engineering , 2009, Empirical Software Engineering.

[8]  Scott Reeves,et al.  Qualitative research methodologies: ethnography , 2008, BMJ : British Medical Journal.

[9]  P. Willis,et al.  Manifesto for Ethnography , 2000 .

[10]  Anders Sigfridsson,et al.  On qualitative methodologies and dispersed communities: Reflections on the process of investigating an open source community , 2011, Inf. Softw. Technol..

[11]  Daniela Cruzes,et al.  Analyzing the Impact of Beliefs in Software Project Practices , 2011, 2011 International Symposium on Empirical Software Engineering and Measurement.

[12]  Helen Sharp,et al.  Using ethnographic methods in software engineering research , 2010, 2010 ACM/IEEE 32nd International Conference on Software Engineering.

[13]  Wayne G. Lutters,et al.  Revealing actual documentation usage in software maintenance through war stories , 2007, Inf. Softw. Technol..

[14]  Sherry B. Ortner,et al.  Access: Reflections on studying up in Hollywood , 2010 .

[15]  Eric Lassiter,et al.  Collaborative Ethnography and Public Anthropology by Luke , 2005 .

[16]  A. J. Cowling,et al.  Using ethnographic methods to carry out human factors research in software engineering , 2006, Behavior research methods.

[17]  Tore Dybå,et al.  The Future of Empirical Methods in Software Engineering Research , 2007, Future of Software Engineering (FOSE '07).

[18]  Tore Dybå,et al.  Introducing knowledge redundancy practice in software development: Experiences with job rotation in support work , 2010, Inf. Softw. Technol..

[19]  Helen Sharp,et al.  Ethnographically-informed empirical studies of software practice , 2007, Inf. Softw. Technol..

[20]  Colin Robson,et al.  Real world research : a resource for users of social research methods in applied settings , 2011 .

[21]  Guilherme Horta Travassos,et al.  Action Research Can Swing the Balance in Experimental Software Engineering , 2013, Adv. Comput..

[22]  William Julius Wilson,et al.  The role of theory in ethnographic research , 2009 .

[23]  Yvonne Dittrich,et al.  Cooperative method development , 2008, Empirical Software Engineering.

[24]  Martin Forsey,et al.  Ethnography as participant listening , 2010 .

[25]  Jennifer Attride-Stirling.  Thematic networks: an analytic tool for qualitative research , 2001 .

[26]  Daniela Cruzes,et al.  Recommended Steps for Thematic Synthesis in Software Engineering , 2011, 2011 International Symposium on Empirical Software Engineering and Measurement.