What Do Hackathons Do? Understanding Participation in Hackathons Through Program Theory Analysis

Hackathons are increasingly embraced across diverse sectors as a way of democratizing the design of technology. Several attempts have been made to redefine the format and desired end goal of hackathons in recent years thereby warranting closer methodological scrutiny. In this paper, we apply program theory to analyze the processes and effects of 16 hackathon case studies through published research literature. Building upon existing research on hackathons, our work offers a critical perspective examining the methodological validity of hackathons and exemplifies how specific processes for organizing hackathons are modified for different purposes. Our main contribution is a program theory analysis of hackathon formats that provides an exploration and juxtaposition of 16 case studies in terms of causal relations between the input, process and the effects of hackathons. Our cataloguing of examples can serve as an inspirational planning resource for future organizers of hackathons.

[1]  Daniela Karin Rosner,et al.  Hacking Culture, Not Devices: Access and Recognition in Feminist Hackerspaces , 2015, CSCW.

[2]  Jon Froehlich,et al.  Personal informatics in the wild: hacking habits for health & happiness , 2013, CHI Extended Abstracts.

[3]  Kiev Gama,et al.  Developing Course Projects in a Hack Day: An Experience Report , 2019, ITiCSE.

[4]  Kiev Gama,et al.  Mapathons and Hackathons to Crowdsource the Generation and Usage of Geographic Data , 2019, ICGJ.

[5]  Alexis Hope,et al.  Hackathons as Participatory Design: Iterating Feminist Utopias , 2019, CHI.

[6]  Fabro Steibel,et al.  MUDAMOS: a civil society initiative on collaborative lawmaking in Brazil , 2019, ICEGOV.

[7]  Matt Ratto,et al.  Critical making hackathon: situated hacking, surveillance and big data proposal , 2014, CHI Extended Abstracts.

[8]  Barbara Dinter,et al.  What the Hack? - Towards a Taxonomy of Hackathons , 2019, BPM.

[9]  M. Brough.  Toward Cultural Epidemiology: Beyond Epistemological Hegemony , 2013 .

[10]  Nick Taylor,et al.  Community Inventor Days: Scaffolding Grassroots Innovation with Maker Events , 2017, Conference on Designing Interactive Systems.

[11]  Amalia de Götzen,et al.  The hackathon format: an analysis of its possible interpretations under a service design perspective , 2020 .

[12]  Silvia Lindtner,et al.  How Methods Make Designers , 2017, CHI.

[13]  Ben Matthews,et al.  The community garden hack: participatory experiments in facilitating primary school teacher's appropriation of technology , 2017, OZCHI.

[14]  Eevi E. Beck,et al.  P for Political: Participation is Not Enough , 2002 .

[15]  Philip J. Guo,et al.  Hack.edu: Examining How College Hackathons Are Perceived By Student Attendees and Non-Attendees , 2017, ICER.

[16]  James D. Herbsleb,et al.  Designing Corporate Hackathons With a Purpose: The Future of Software Development , 2019, IEEE Software.

[17]  Lilly C. Irani,et al.  Hackathons and the Making of Entrepreneurial Citizenship , 2015 .

[18]  Randolph G. Bias,et al.  Research Methods for Human-Computer Interaction , 2010, J. Assoc. Inf. Sci. Technol..

[19]  Jeremy Singer,et al.  Experience Report: Thinkathon -- Countering an "I Got It Working" Mentality with Pencil-and-Paper Exercises , 2019, ITiCSE.

[20]  Nick Taylor,et al.  Strategies for Engaging Communities in Creating Physical Civic Technologies , 2018, CHI.

[21]  Samia Khan,et al.  Cultivating the Under-Mined: Cross-Case Analysis as Knowledge Mobilization , 2008 .

[22]  Kristina Höök,et al.  Strong concepts: Intermediate-level knowledge in interaction design research , 2012, TCHI.

[23]  Frances Brazier,et al.  Together We Can Make It Work! Toward a Design Framework for Inclusive and Participatory City-Making of Playable Cities , 2020, Frontiers in Computer Science.

[24]  Jaya Narain,et al.  ATHack: Co-Design and Education in Assistive Technology Development , 2020, CHI Extended Abstracts.

[25]  Michael Twidale,et al.  Co-designing Scientific Software: Hackathons for Participatory Interface Design , 2016, CHI Extended Abstracts.

[26]  Charles M. Reigeluth,et al.  Instructional-design Theories and Models : A New Paradigm of Instructional Theory, Volume II , 1999 .

[27]  James R. Wallace,et al.  Post-Hackathon Learning Circles: Supporting Lean Startup Development , 2020, CHI Extended Abstracts.

[28]  James D. Herbsleb,et al.  How to Support Newcomers in Scientific Hackathons - An Action Research Study on Expert Mentoring , 2020, Proc. ACM Hum. Comput. Interact..

[29]  Adam Wierzbicki,et al.  Older adults and hackathons: a qualitative study , 2017, Empirical Software Engineering.

[30]  Patrick Olivier,et al.  Self Harmony: Rethinking Hackathons to Design and Critique Digital Technologies for Those Affected by Self-Harm , 2017, CHI.

[31]  Claus Bossen,et al.  Program theory for participatory design , 2018, PDC.

[32]  Olaf Drögehorn,et al.  Hackathons in Software Engineering Education - Lessons Learned from a Decade of Events , 2018, 2018 IEEE/ACM International Workshop on Software Engineering Education for Millennials (SEEM).

[33]  Frank J. Frey,et al.  The innovation-driven hackathon: one means for accelerating innovation , 2016, EuroPLoP.

[34]  Elizabeth Gerber,et al.  Reappropriating Hackathons: The Production Work of the CHI4Good Day of Service , 2017, CHI.

[35]  Christine Nadel,et al.  Case Study Research Design And Methods , 2016 .

[36]  K. Eisenhardt.  Building theories from case study research , 1989, STUDI ORGANIZZATIVI.

[37]  Kim Halskov,et al.  How Participatory Design Works: Mechanisms and Effects , 2019, OZCHI.

[38]  Maria Cláudia Figueiredo Pereira Emer,et al.  Short Datathon for the Interdisciplinary Development of Data Analysis and Visualization Skills , 2019, 2019 IEEE/ACM 12th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE).

[39]  James D. Herbsleb,et al.  How to organize a hackathon - A planning kit , 2020, ArXiv.

[40]  Marina Jirotka,et al.  Lab Hackathons to Overcome Laboratory Equipment Shortages in Africa: Opportunities and Challenges , 2019, CHI Extended Abstracts.

[41]  Claus Bossen,et al.  Evaluation in participatory design: a literature survey , 2016, PDC.

[42]  Nick Taylor,et al.  Everybody's Hacking: Participation and the Mainstreaming of Hackathons , 2018, CHI.

[43]  Amanda L. Griffith,et al.  Persistence of Women and Minorities in STEM Field Majors: Is it the School That Matters? , 2010 .

[44]  Jeanette Falk Olesen,et al.  10 Years of Research With and On Hackathons , 2020, Conference on Designing Interactive Systems.

[45]  Yasmin B. Kafai,et al.  StitchFest: Diversifying a College Hackathon to Broaden Participation and Perceptions in Computing , 2015, SIGCSE.

[46]  Kiev Gama,et al.  Preliminary Findings on Software Engineering Practices in Civic Hackathons , 2017, 2017 IEEE/ACM 4th International Workshop on CrowdSourcing in Software Engineering (CSI-SE).

[47]  James D. Herbsleb,et al.  How to Hackathon: Socio-technical Tradeoffs in Brief, Intensive Collocation , 2016, CSCW.

[48]  Patricia J. Rogers,et al.  Program theory evaluation: Practice, promise, and problems , 2000 .

[49]  Susanne Bødker,et al.  Participatory Design that Matters—Facing the Big Issues , 2018, ACM Trans. Comput. Hum. Interact..

[50]  L. Bickman.  The functions of program theory , 1987 .