Cowboys, ankle sprains, and keepers of quality: how is video game development different from software development?

Video games make up an important part of the software industry, yet the software engineering community rarely studies video games. This imbalance is a problem if video game development differs from general software development, as some game experts suggest. In this paper we describe a study with 14 interviewees and 364 survey respondents. The study elicited substantial differences between video game development and other software development. For example, in game development, “cowboy coders” are necessary to cope with the continuous interplay between creative desires and technical constraints. Consequently, game developers are hesitant to use automated testing because of these tests’ rapid obsolescence in the face of shifting creative desires of game designers. These differences between game and non-game development have implications for research, industry, and practice. For instance, as a starting point for impacting game development, researchers could create testing tools that enable game developers to create tests that assert flexible behavior with little up-front investment.

[1]  Emerson Murphy-Hill,et al.  Motion Sickness Susceptibility in Software Developers , 2014 .

[2]  Richard E. Fairley,et al.  Guide to the Software Engineering Body of Knowledge (SWEBOK(R)): Version 3.0 , 2014 .

[3]  Christian Bird,et al.  Diversity in software engineering research , 2013, ESEC/FSE 2013.

[4]  Kari Smolander,et al.  What do game developers expect from development and design tools? , 2013, EASE '13.

[5]  Shenja van der Graaf,et al.  Get Organized At Work! A Look Inside the Game Design Process of Valve and Linden Lab , 2012 .

[6]  James M. Boyle,et al.  A systematic literature review of empirical evidence on computer games and serious games , 2012, Comput. Educ..

[7]  Thierry Burger-Helmchen,et al.  User Communities and Social Software in the Video Game Industry , 2011 .

[8]  Jim Whitehead,et al.  The whats and the whys of games and software engineering , 2011, GAS '11.

[9]  Annakaisa Kultima,et al.  “Hopefully everything I'm doing has to do with innovation”: Games industry professionals on innovation in 2009 , 2010, 2010 2nd International IEEE Consumer Electronics Society's Games Innovations Conference.

[10]  Jing Li,et al.  The Qualitas Corpus: A Curated Collection of Java Code for Empirical Studies , 2010, 2010 Asia Pacific Software Engineering Conference.

[11]  Michael Thornton Wyman,et al.  Making Great Games: An Insider's Guide to Designing and Developing the World's Greatest Video Games , 2010 .

[12]  Marcelo Soares Pimenta,et al.  Is agility out there?: agile practices in game development , 2010, SIGDOC '10.

[13]  Ioannis Stamelos,et al.  Software engineering research for computer games: A systematic review , 2010, Inf. Softw. Technol..

[14]  Noah Wardrip-Fruin,et al.  What went wrong: a taxonomy of video game bugs , 2010, FDG.

[15]  Joe Nandhakumar,et al.  A temporal perspective of the computer game development process , 2009, Inf. Syst. J..

[16]  Christopher L. Moore,et al.  Digital Games Distribution: The Presence of the Past and the Future of Obsolescence , 2009 .

[17]  Hisham M. Haddad,et al.  Software Engineering Challenges in Game Development , 2009, 2009 Sixth International Conference on Information Technology: New Generations.

[18]  Marcelo Soares Pimenta,et al.  What went wrong? A survey of problems in game development , 2009, CIE.

[19]  Morgan McGuire,et al.  Creating games - mechanics, content, and technology , 2008 .

[20]  Piramanayagam Arumuga Nainar,et al.  Finding and Reproducing Heisenbugs in Concurrent Programs , 2008, OSDI.

[21]  Marcelo Soares Pimenta,et al.  Houston, we have a problem...: a survey of actual problems in computer games development , 2008, SAC '08.

[22]  F. Ted Tschang,et al.  Balancing the Tensions Between Rationalization and Creativity in the Video Games Industry , 2007, Organ. Sci..

[23]  Stephen E. Humphrey,et al.  Integrating motivational, social, and contextual work design features: a meta-analytic summary and theoretical extension of the work design literature. , 2007, The Journal of applied psychology.

[24]  J. Szczypula,et al.  Idea Creation, Constructivism and Evolution as Key Characteristics in the Videogame Artifact Design Process , 2006 .

[25]  Heather Maxwell Chandler,et al.  The Game Production Handbook , 2006 .

[26]  Gregg Rothermel,et al.  Supporting Controlled Experimentation with Testing Techniques: An Infrastructure and its Potential Impact , 2005, Empirical Software Engineering.

[27]  Kevin A. Schneider,et al.  Requirements engineering and the creative process in the video game industry , 2005, 13th IEEE International Conference on Requirements Engineering (RE'05).

[28]  Ted Tschang,et al.  VIDEOGAMES AS INTERACTIVE EXPERIENTIAL PRODUCTS AND THEIR MANNER OF DEVELOPMENT , 2005 .

[29]  Jonathan Blow,et al.  Game Development: Harder Than You Think , 2004, ACM Queue.

[30]  R. Gottlieb,et al.  Alienation and Freedom , 2003 .

[31]  Yasunori Baba,et al.  PRODUCT DEVELOPMENT IN JAPANESE TV GAME SOFTWARE: THE CASE OF AN INNOVATIVE GAME , 2001 .

[32]  Kevin MacG. Adams,et al.  The Guide to the Software Engineering Body of Knowledge , 1999, IEEE Softw..

[33]  T A Beery,et al.  Gender bias in the diagnosis and treatment of coronary artery disease. , 1995, Heart & lung : the journal of critical care.

[34]  Barry W. Boehm,et al.  A spiral model of software development and enhancement , 1986, Computer.

[35]  H. Braverman.  Labor and Monopoly Capital , 1974 .

[36]  Robert Blauner,et al.  Alienation and Freedom , 1965 .

[37]  Tim Marsh,et al.  Serious games continuum: Between games for purpose and experiential environments for purpose , 2011, Entertain. Comput..

[38]  Stefan Biffl,et al.  A Survey on a State of the Practice in Video Game Development , 2010 .

[39]  Erik Bethke,et al.  Game development and production , 2003 .

[40]  A Straw,et al.  Guide to the Software Engineering Body of Knowledge , 1998 .

[41]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .