Combining Qualitative and Quantitative Methods in Information Systems Research: A Case Study

This article reports how quantitative and qualitative methods were combined in a longitudinal multidisciplinary study of interrelationships between perceptions of work and a computer information system. The article describes the problems and contributions stemming from different research perspectives and methodological approaches. It illustrates four methodological points: (1) the value of combining qualitative and quantitative methods; (2) the need for context-specific measures of job characteristics rater than exclusive reliance on standard context-independent instruments; (3) the importance of process measures when evaluating the information systems; and (4) the need to explore the necessary relationships between a computer system and the perceptions of its users, rather than unidirectional assessment of computer system impacts on users or of users characteristics on computer system implementation. Despite the normative nature of these points, the most important conclusion ins the desirability for a variety of approaches to studying information systems. No one approach to information systems research can provide the richness that information systems, as a discipline, needs for further advancement.

[1]  Chris W. Clegg,et al.  Information technology and job design: a case study on computerized numerically controlled machine tool working , 1987 .

[2]  S. Barley.  Technology as an occasion for structuring: evidence from observations of CT scanners and the social order of radiology departments. , 1986, Administrative science quarterly.

[3]  Blake Ives,et al.  User Involvement and MIS Success: A Review of Research , 1984 .

[4]  William J. Haga,et al.  A vertical dyad linkage approach to leadership within formal organizations: A longitudinal investigation of the role making process , 1975 .

[5]  Shoshana Zuboff,et al.  In the Age of the Smart Machine: The Future of Work and Power , 1989 .

[6]  John,et al.  Reclaiming Qualitative Methods for Organizational Research: A Preface. , 1979 .

[7]  Gerald R. Ferris,et al.  A methodological note on job complexity indexes. , 1985 .

[8]  T. Jick.  Mixing Qualitative and Quantitative Methods: Triangulation in Action. , 1979 .

[9]  Gerardine DeSanctis,et al.  ICIS Paper: Methodological Issues in Experimental IS Research: Experiences and Recommendations , 1985, MIS Q..

[10]  BenbasatIzak,et al.  The case research strategy in studies of information systems , 1987 .

[11]  Rudy Hirschheim,et al.  A Social Action Perspective of Information Systems Development , 1987, ICIS.

[12]  David B. Pillemer,et al.  Numbers and Narrative: Combining Their Strengths in Research Reviews , 1982 .

[13]  Richard,et al.  Motivation through the Design of Work: Test of a Theory. , 1976 .

[14]  M. Trend,et al.  On The Reconciliation of Qualitative and Quantitative Analyses: A Case Study , 1978 .

[15]  Richard J. Boland,et al.  The Process and Product of System Design , 1978 .

[16]  Rob Kling,et al.  Social Analyses of Computing: Theoretical Perspectives in Recent Empirical Research , 1980, CSUR.

[17]  R. Brickman,et al.  The evaluation enterprise, by William R. Meyers. San Francisco: CA: Jossey-Bass, 1981, 266 pp. Price: $15.95 cloth , 1983 .

[18]  Linda S. Lotto.  Qualitative Data Analysis: A Sourcebook of New Methods , 1986 .

[19]  Henry Mintzberg.  The Nature of Managerial Work , 1974, Operational Research Quarterly (1970-1977).

[20]  Kalle Lyytinen,et al.  Different perspectives on information systems: problems and solutions , 1987, CSUR.

[21]  R. Yin.  Case Study Research: Design and Methods , 1984 .

[22]  Daniel Robey,et al.  An investigation of user-led system design: rational and political perspectives , 1984, CACM.

[23]  P. Shrout.  Quasi-experimentation: Design and analysis issues for field settings: by Thomas D. Cook and Donald T. Campbell. Chicago: Rand McNally, 1979 , 1980 .

[24]  R Nicol,et al.  A survey of the state of the art of clinical biochemistry laboratory computerisation. , 1986, International journal of bio-medical computing.

[25]  Enid Mumford,et al.  Designing participatively : a participative approach to computer systems design : a case study of the introduction of a new computer system , 1979 .

[26]  Izak Benbasat,et al.  The MIS area: problems, challenges, and opportunities , 1982, DATB.

[27]  Kristen H. Kjerulff,et al.  Predicting Employee Adaptation to the Implementation of a Medical Information System , 1982 .

[28]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[29]  M. Lynne Markus,et al.  Power, politics, and MIS implementation , 1987, CACM.

[30]  M. Harris.  Varieties of qualitative research , 1982 .

[31]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[32]  W DicksonGary,et al.  Methodological issues in experimental IS research , 1985 .

[33]  P. F. Secord,et al.  Implications for psychology of the new philosophy of science. , 1983 .

[34]  Michael Quinn Patton,et al.  Utilization-Focused Evaluation , 1979 .

[35]  J. Farh,et al.  The Job Characteristics Model in Hong Kong , 1986 .

[36]  Michael J. Ginzberg,et al.  MIS and the behavioral sciences: research patterns and prescriptions , 1982, DATB.

[37]  Niels Bjørn-Andersen,et al.  Panel 1: The Use of Qualitative Methods in MIS Research , 1986, ICIS.

[38]  T. Bonoma.  Case Research in Marketing: Opportunities, Problems, and a Process , 1985 .

[39]  N. P. Vitalari,et al.  The need of longitudinal designs in the study of computing environments , 1986, Trends in Information Systems.

[40]  J. Hisnanick.  In the age of the smart machine: The future of work and power , 1989 .

[41]  T L Lincoln,et al.  Computers, health care, and medical information science. , 1980, Science.

[42]  M. Markus,et al.  Information technology and organizational change: causal structure in theory and research , 1988 .

[43]  P. Meehl.  Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. , 1978 .

[44]  Jon Hartwick,et al.  The Impact of Automated Office Systems on Middle Managers and Their Work , 1987, MIS Q..

[45]  Rob Kling,et al.  The Web of Computing: Computer Technology as Social Organization , 1982, Adv. Comput..

[46]  Kuldeep Kumar,et al.  Methodologies for Socio-Technical-Systems (STS) Development: a Comparison , 1987, ICIS.

[47]  Guy Fitzgerald,et al.  Research methods in information systems , 1985 .

[48]  Enid Mumford.  From Bank Teller to Office Worker : The Pursuit of Systems Designed for People in Practice and Research , 1985, ICIS.

[49]  Robert J. House,et al.  Toward the measurement of organizational practices: Scale development and validation. , 1972 .

[50]  E. Bredo,et al.  Knowledge and Values in Social and Educational Research , 1983 .

[51]  T. Cook,et al.  Qualitative and quantitative methods in evaluation research , 1981 .

[52]  Yannis Bakos,et al.  Dependent Variables for the Study of Firm and Industry-Level Impacts of Information Technology , 2013, ICIS.

[53]  Richard L. Daft,et al.  Measures of Perrow's Work Unit Technology: An Empirical Assessment and a New Scale , 1983 .

[54]  Enid Mumford,et al.  A participative approach to computer systems design , 1979 .

[55]  Bonnie Kaplan,et al.  Job-Related Responses to a Clinical Laboratory Computer Information System Seven Months Post Implementation , 1987, HCI.