Evaluating impact in the ROS ecosystem

The ROS ecosystem is an interconnected web of packages, nodes and people with no efficient means to compare, assess or visualize them. We develop a set of tools consisting of various metrics, a data visualization web app, and an active monitoring system. With these tools, we measure the current state of the ecosystem as well as determine where the community should direct their efforts. We also encourage the community to provide input on potential applications, additional metrics, and further improvements to address the needs of the ROS ecosystem. We incentivize this input by gamifying community contributions to the infrastructure. Encouraging user-driven improvements to the ROS infrastructure through the use of a leaderboard and friendly competition will advance ROS development and community support far into the future.

[1]  Jason E. Robbins.  Adopting Open Source Software Engineering (OSSE) Practices by Adopting OSSE Tools , 2003 .

[2]  Brian Fitzgerald,et al.  Why Hackers Do What They Do: Understanding Motivation and Effort in Free/Open Source Software Projects , 2007 .

[3]  Bernard Golden.  Making Open Source Ready for the Enterprise: The Open Source Maturity Model , 2008 .

[4]  Mônica G. Campiteli,et al.  Is it possible to compare researchers with different scientific interests? , 2006, Scientometrics.

[5]  Sandro Morasca,et al.  An Investigation of the Users' Perception of OSS Quality , 2010, OSS.

[6]  Eric A. von Hippel,et al.  How Open Source Software Works: 'Free' User-to-User Assistance? , 2000 .

[7]  Sebastian Spaeth,et al.  Carrots and Rainbows: Motivation and Social Practice in Open Source Software Development , 2012, MIS Q..

[8]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[9]  Edward L. Deci,et al.  Intrinsic Motivation and Self-Determination in Human Behavior , 1975, Perspectives in Social Psychology.

[10]  Brian Fitzgerald,et al.  Understanding Free/Open Source Software Development Processes , 2006, Softw. Process. Improv. Pract..

[11]  Zhijiang Dong,et al.  Engaging Computer Science Students through Gamification in an Online Social Network Based Collaborative Learning Environment , 2013 .

[12]  Bart Jacobs,et al.  Increased security through open source , 2007, Commun. ACM.

[13]  Mônica G. Campiteli,et al.  An index to quantify an individual's scientific research valid across disciplines , 2005 .

[14]  Brian Fitzgerald,et al.  Understanding Free Software Developers: Findings from the FLOSS Study , 2007 .

[15]  Sandra Slaughter,et al.  Understanding the Motivations, Participation, and Performance of Open Source Software Developers: A Longitudinal Study of the Apache Projects , 2006, Manag. Sci..

[16]  Douglas C. Schmidt,et al.  Leveraging Open-Source Communities To Improve the Quality & Performance of Open-Source Software , 2001 .

[17]  Paul J. Adams,et al.  Call for Quality: Open Source Software Quality Observation , 2006, OSS.

[18]  Alexander Hars,et al.  Working for free? Motivations of participating in open source projects , 2001, Proceedings of the 34th Annual Hawaii International Conference on System Sciences.

[19]  Ho-Won Jung,et al.  Measuring software product quality: a survey of ISO/IEC 9126 , 2004, IEEE Software.

[20]  Giordano Tamburrelli,et al.  Understanding gamification mechanisms for software development , 2013, ESEC/FSE 2013.

[21]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.