The sociology of a market analysis tool: How industry analysts sort vendors and organize markets

The information technology (IT) marketplace appears to be shaped by new kinds of specialist industry analysts that link technology supply and use through offering a commodified form of knowledge and advice. We focus on the work of one such organisation, the Gartner Group, and with how it produces a market analysis tool called the 'Magic Quadrant'. Widely circulated amongst the IT community, the device compares and sorts vendors according to a number of more or less intangible properties (such as vendor 'competence' and 'vision'). Given that potential adopters of IT systems are drawn to assess the reputation and likely behaviour of vendors, these tools play an important role in mediating choice during procurement. Our interest is in understanding how such objects are constructed as well as how they wield influence. We draw on the recent 'performativity' debate in Economic Sociology and the Sociology of Finance to show how Magic Quadrants are not simply describing but reshaping aspects of the IT arena. Importantly, in sketching this sociology of a market analysis tool, we also attend to the contested nature of the Magic Quadrant. Whilst Gartner attempt to establish this device as an 'impartial' and 'legitimate' arbiter of vendor performance, it is often viewed sceptically on the grounds that industry analysts are not always independent of the vendors they are assessing. Paradoxically these devices remain influential despite these sceptical assessments.

[1]  I. Hacking The Social Construction of What , 1999 .

[2]  Ping Wang,et al.  Launching professional services automation: Institutional entrepreneurship for information technology innovations , 2007, Inf. Organ..

[3]  Michael R. Lissack,et al.  Models without Morals: Toward the Ethical Use of Business Models , 2003 .

[4]  M. Callon,et al.  On Qualculation, Agency, and Otherness , 2005 .

[5]  Steve Sawyer,et al.  A market-based perspective on information systems development , 2001, CACM.

[6]  N. Thrift Environment and Planning D: Society and Space , 1995 .

[7]  Thomas Armbrüster,et al.  Bridging Uncertainty in Management Consulting: The Mechanisms of Trust and Networked Reputation , 2003 .

[8]  Ben Light,et al.  Reflections on issues of power in packaged software selection , 2006, Inf. Syst. J..

[9]  David R. Firth,et al.  How useful are IT research and analysis services , 2005 .

[10]  S. Cole,et al.  : A Social History of Truth: Civility and Science in Seventeenth-Century England , 1996 .

[11]  C. Ciborra,et al.  Book Review: The Social Study of Information and Communication Technology: Innovation, Actors, and Contexts , 2004 .

[12]  M. Callon What Does It Mean to Say That Economics Is Performative? , 2006, Do Economists Make Markets?.

[13]  O. Williamson,et al.  Markets and Hierarchies: Analysis and Antitrust Implications. , 1977 .

[14]  D. MacKenzie,et al.  Assembling an Economic Actor: The Agencement of a Hedge Fund , 2007 .

[15]  Stephen Harwood ERP: The Implementation Cycle , 2003 .

[16]  Johannes Glückler,et al.  Organizational Change and the Economics of Management Consulting: A Response to Sorge and van Witteloostuijn , 2007 .

[17]  D. MacKenzie Is Economics Performative? Option Theory and the Construction of Derivatives Markets , 2006, Journal of the History of Economic Thought.

[18]  Donald MacKenzie,et al.  Authors’ Addresses , 2006 .

[19]  Robin Williams,et al.  Technology Choice and its Performance : Toward a Sociology of Software Package Procurement , 2009 .

[20]  P. Ghemawat Competition and Business Strategy in Historical Perspective , 2000, Business History Review.

[21]  Asaf Darr,et al.  Selling Technology , 2019 .

[22]  B. Barnes Social Life as Bootstrapped Induction , 1983 .

[23]  H. Scarbrough,et al.  Expertise and Innovation , 1995 .

[24]  M. Callon Actor-Network Theory—The Market Test , 1999 .

[25]  Eric T. G. Wang Transaction attributes and software outsourcing success: an empirical investigation of transaction cost theory , 2002, Inf. Syst. J..

[26]  Tom D. Burks USE OF INFORMATION TECHNOLOGY RESEARCH ORGANIZATIONS AS INNOVATION SUPPORT AND DECISION MAKING TOOLS , 2006 .

[27]  Alex Preda,et al.  Legitimacy and status groups in financial markets. , 2005, The British journal of sociology.

[28]  M. Callon,et al.  The economy of qualities , 2002 .

[29]  Michael Power,et al.  Auditing and the production of legitimacy , 2003 .

[30]  Margaret Morrison,et al.  Models as Mediators: Perspectives on Natural and Social Science , 1999 .

[31]  Costas Azariadis,et al.  Self-fulfilling prophecies , 1981 .

[32]  Margaret Morrison,et al.  Models as Mediators , 1999 .

[33]  Alex Preda,et al.  Where do Analysts Come from? The Case of Financial Chartism , 2007 .

[34]  Diana E. Forsythe,et al.  “It's Just a Matter of Common Sense”: Ethnography as Invisible Work , 1999, Computer Supported Cooperative Work (CSCW).

[35]  Michel Callon,et al.  An Essay on Framing and Overflowing: Economic Externalities Revisited by Sociology , 1998 .

[36]  Robin Williams,et al.  Software and Organisations: The Biography of the Enterprise-Wide System or How SAP Conquered the World , 2008 .

[37]  S. Newell,et al.  The Role of Professional Associations in Technology Diffusion , 1995 .

[38]  A. Rip Folk Theories of Nanotechnologists , 2006, The Ethics of Nanotechnology, Geoengineering and Clean Energy.

[39]  W. Dugger The Economic Institutions of Capitalism , 1987 .

[40]  Ian Hacking,et al.  A Social History of Truth: Civility and Science in Seventeenth-Century England. , 1995 .

[41]  Brian P. Bloomfield,et al.  THE ROLE OF MANAGEMENT CONSULTANTS IN THE DEVELOPMENT OF INFORMATION TECHNOLOGY: THE INDISSOLUBLE NATURE OF SOCIO‐POLITICAL AND TECHNICAL SKILLS* , 1995 .

[42]  David C. Wilson,et al.  Actionable Strategy Knowledge:: A Practice Perspective☆ , 2006 .

[43]  Alfred Kieser,et al.  On Communication Barriers between Management Science, Consultancies and Business Companies , 2002 .

[44]  Csr Young,et al.  How to Do Things With Words , 2009 .

[45]  Michael Parent,et al.  An exploration of enterprise technology selection and evaluation , 2004, J. Strateg. Inf. Syst..

[46]  Andrew Sturdy,et al.  The Consultancy Process — An Insecure Business? , 1997 .

[47]  O. Williamson,et al.  The Economic Institutions of Capitalism: Firms, Markets, Relational Contracting. , 1986, American Political Science Review.

[48]  E. Burton Swanson,et al.  Organizing Visions for Information Technology and the Information Systems Executive Response , 2003, J. Manag. Inf. Syst..

[49]  M. Callon,et al.  Economic markets as calculative collective devices , 2005 .

[50]  Peter Miller Governing by Numbers: Why Calculative Practices Matter , 2008 .

[51]  D. MacKenzie An Engine, Not a Camera: How Financial Models Shape Markets , 2006 .

[52]  Theo Vurdubakis,et al.  The vision thing: constructing technology and the future in management advice , 2002 .

[53]  Jonathon E. Mote,et al.  The laws of the markets , 2000 .

[54]  Matthew Jones,et al.  The expert system: constructing expertise in an IT/management consultancy , 2003, Inf. Organ..

[55]  L. Engwall,et al.  Management Consulting : Emergence and Dynamics of a Knowledge industry , 2003 .

[56]  Clinton Free,et al.  The Construction of Auditability: MBA Rankings and Assurance in Practice , 2009 .

[57]  Wiebe E. Bijker,et al.  Science in action : how to follow scientists and engineers through society , 1989 .

[58]  S. Turner What is the Problem with Experts? , 2001 .

[59]  David Edgerton Self-fulfilling prophecies , 1996, Nature.

[60]  Graham Field,et al.  Analyzing the analysts , 2005 .

[61]  J. Kallinikos Farewell to constructivism: technology and context-embedded action , 2004 .

[62]  Jan Mouritsen,et al.  Sticky Reputation: Analyzing a Ranking System , 2001 .

[63]  Philip Mirowski,et al.  Trust in Numbers: The Pursuit of Objectivity in Science and Public Life , 1996 .

[64]  D. MacKenzie An Equation and its Worlds , 2003 .

[65]  M. Callon,et al.  Peripheral Vision , 2005 .

[66]  J. Hassard,et al.  Actor Network Theory and After , 1999 .

[67]  Mads Borup,et al.  The sociology of expectations in science and technology , 2006, Technol. Anal. Strateg. Manag..