The use of focus groups in complex and pressurised IS studies and evaluation using Klein & Myers principles for interpretive research

Studies of information systems (IS) often involve many complexities, uncertainties and restrictions. As a result, researchers have to adopt innovative research approaches or tailor and extend existing ones. This paper describes and evaluates an innovative focus group approach used to study three IS development teams, which had to cope with the application of a broad, polymorphous framework, untested in practice, seeking to elicit potentially highly sensitive opinions and judgements in a highly pressurised, time‐restricted environment. This paper makes two significant contributions. To conduct this evaluation, the researchers operationalised the Klein & Myers seven principles for interpretive study for the first time, creating a set of questions that other IS researchers can now use to evaluate their own interpretive studies. The paper also applies these to the design of the focus groups and develops a set of recommendations for future IS researchers to consider based on lessons learned in this study.

[1]  Robert K. Merton,et al.  The Focused Interview , 1946, American Journal of Sociology.

[2]  M. Patton.  Qualitative research and evaluation methods , 1980 .

[3]  P. Brink.  On reliability and validity in qualitative research. , 1987, Western journal of nursing research.

[4]  D. Morgan.  Focus groups for qualitative research. , 1988, Hospital guest relations report.

[5]  S. A. Pedersen.  [Validity of qualitative research]. , 1990, Ugeskrift for laeger.

[6]  Wanda J. Orlikowski,et al.  Studying Information Technology in Organizations: Research Approaches and Assumptions , 1991, Inf. Syst. Res..

[7]  G. Huber.  Organizational Learning: The Contributing Processes and the Literatures , 1991 .

[8]  Thomas H. Lee,et al.  A New American Tqm: Four Practical Revolutions In Management , 1993 .

[9]  Ricky W. Griffin,et al.  Toward a Theory of Organizational Creativity , 1993 .

[10]  Karen Locke,et al.  Appealing Work: An Investigation of How Ethnographic Texts Convince , 1993 .

[11]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[12]  David L. Altheide,et al.  Criteria for assessing interpretive validity in qualitative research. , 1994 .

[13]  J. Kitzinger.  The methodology of focus groups: the importance of interaction between research participants , 1994 .

[14]  Geoff Walsham,et al.  Interpretive case studies in IS research: nature and method , 1995 .

[15]  Richard T. Watson,et al.  Service Quality: A Measure of Information System Effectiveness , 1995, MIS Q..

[16]  Y. Lincoln.  Emerging Criteria for Quality in Qualitative and Interpretive Research , 1995 .

[17]  Anne Goulding,et al.  Focus Groups: Their Use in LIS Research Data Collection. , 1996 .

[18]  S. Wilkinson.  Focus group methodology: a review , 1998 .

[19]  J. Sim,et al.  Collecting and analysing qualitative data: issues raised by the focus group. , 1998, Journal of advanced nursing.

[20]  M. Budden.  Focus groups: Theory and practice , 1999 .

[21]  Michael D. Myers,et al.  A Set of Principles for Conducting and Evaluating Interpretive Field Studies in Information Systems , 1999, MIS Q..

[22]  T. Hines.  An evaluation of two qualitative methods (focus group interviews and cognitive maps) for conducting research into entrepreneurial decision making , 2000 .

[23]  Gunther Eysenbach,et al.  Consumer health informatics , 2000, BMJ : British Medical Journal.

[24]  Arthur P. Bochner.  Criteria Against Ourselves , 2000 .

[25]  P. Kidd,et al.  Getting the Focus and the Group: Enhancing Analytical Rigor in Focus Group Research , 2000, Qualitative health research.

[26]  Izak Benbasat,et al.  Factors That Influence the Social Dimension of Alignment Between Business and Information Technology Objectives , 2000, MIS Q..

[27]  J. Ruiz Moreno.  [Organizational learning]. , 2001, Revista de enfermeria.

[28]  J. Morse,et al.  Verification Strategies for Establishing Reliability and Validity in Qualitative Research , 2002 .

[29]  Sharon Bailin.  CREATIVITY IN CONTEXT , 2002 .

[30]  R. Edwards,et al.  Interpreters/Translators and Cross-Language Research: Reflexivity and Border Crossings , 2002 .

[31]  Richard Baskerville,et al.  Generalizing Generalizability in Information Systems Research , 2003, Inf. Syst. Res..

[32]  Rudy Hirschheim,et al.  Crisis in the IS Field? A Critical Reflection on the State of the Discipline , 2003, J. Assoc. Inf. Syst..

[33]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[34]  Robert M. Davison,et al.  Principles of canonical action research , 2004, Inf. Syst. J..

[35]  A. Localio,et al.  Role of computerized physician order entry systems in facilitating medication errors. , 2005, JAMA.

[36]  A. Localio,et al.  Role of computerized physician order entry systems in facilitating medication errors. , 2005 .

[37]  Gurpreet Dhillon,et al.  Value‐focused assessment of information system security in organizations , 2006, Inf. Syst. J..

[38]  Anna Buehring,et al.  Evaluating Qualitative Management Research: Towards a Contingent Criteriology , 2006 .

[39]  Shan Ling Pan,et al.  Escalation and de‐escalation of commitment: a commitment transformation analysis of an e‐government project , 2006, Inf. Syst. J..

[40]  Shirley Gregor,et al.  The Nature of Theory in Information Systems , 2006, MIS Q..

[41]  Geoff Walsham,et al.  Doing interpretive research , 2006, Eur. J. Inf. Syst..

[42]  David Stewart,et al.  Focus groups: Theory and practice, 2nd ed. , 2007 .

[43]  R. Barbour.  Doing Focus Groups , 2008 .

[44]  P. Sobreperez,et al.  Using plenary focus groups in information systems research: More than a collection of interviews , 2008 .

[45]  Ojelanki K. Ngwenyama,et al.  Virtual team collaboration: building shared meaning, resolving breakdowns and creating translucence , 2009, Inf. Syst. J..

[46]  Kieran Conboy,et al.  Agility from First Principles: Reconstructing the Concept of Agility in Information Systems Development , 2009, Inf. Syst. Res..

[47]  Thomas Chesney,et al.  Griefing in virtual worlds: causes, casualties and coping strategies , 2009, Inf. Syst. J..

[48]  K. Conboy,et al.  Evaluate an applied focus group approach using Klein & Myers principles , 2012 .