Leveraging the contributory potential of user feedback

Under contribution is an important problem in online social production communities: important tasks don't get done, and only a small minority of participants are active contributors. How can we remedy this situation? We explore the feasibility of using the act of consuming information as a gateway to contributing information; specifically, we investigate semi-automated means to extract useful information from standard types of user feedback. We explore this approach in the context of a geographic wiki and route-planning system for bicyclists. We analyzed naturally occurring textual route feedback, finding that the feedback was rich in information such as bikeability ratings, tags and notes that are useful to improve the system's route finding and navigational assistance capabilities. We also present a technique to extract such information by engaging users in dialogue immediately after they obtain a route. We believe that our results and ideas are applicable to a broad class of social production systems.

[1]  Anind K. Dey,et al.  Navigate like a cabbie: probabilistic reasoning from observed context-aware behavior , 2008, UbiComp.

[2]  Raymond A. Patterson,et al.  Wisdom of the Crowds: Decentralized Knowledge Construction in Wikipedia , 2006 .

[3]  Patrick Henry Winston,et al.  Learning structural descriptions from examples , 1970 .

[4]  John Riedl,et al.  Is seeing believing?: how recommender system interfaces affect users' opinions , 2003, CHI '03.

[5]  Mikhil Masli,et al.  Geowiki + route analysis = improved transportation planning , 2013, CSCW '13.

[6]  Amy Bruckman,et al.  Why it works (when it works): success factors in online creative collaboration , 2010, GROUP.

[7]  John Riedl,et al.  Tag expression: tagging with feeling , 2010, UIST.

[8]  Li Chen,et al.  Critiquing-based recommenders: survey and emerging trends , 2012, User Modeling and User-Adapted Interaction.

[9]  John Riedl,et al.  SuggestBot: using intelligent task routing to help people find work in wikipedia , 2007, IUI '07.

[10]  B. Shneiderman,et al.  The Reader-to-Leader Framework: Motivating Technology-Mediated Social Participation , 2009 .

[11]  Seymour Epstein,et al.  Irrational reactions to negative outcomes : evidence for two conceptual systems , 1992 .

[12]  Chandra R. Bhat,et al.  Commuter Bicyclist Route Choice: Analysis Using a Stated Preference Survey , 2003 .

[13]  Jennifer Preece,et al.  What lurkers and posters think of each other [online community] , 2004, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.

[14]  Ian Witten,et al.  Data Mining , 2000 .

[15]  Barry Smyth,et al.  Personalized Route Planning: A Case-Based Approach , 2000, EWCBR.

[16]  Mikhil Masli,et al.  "How should I go from ___ to ___ without getting killed?": motivation and benefits in open collaboration , 2011, Int. Sym. Wikis.

[17]  Tom Fawcett,et al.  ROC Graphs: Notes and Practical Considerations for Researchers , 2007 .

[18]  L. Terveen,et al.  Becoming Wikipedian : Transformation of Participation in a Collaborative Online Encyclopedia , 2009 .

[19]  Pat Langley,et al.  An adaptive interactive agent for route advice , 1999, AGENTS '99.

[20]  Mikhil Masli,et al.  Evaluating compliance-without-pressure techniques for increasing participation in online communities , 2012, CHI.

[21]  B. Nonnecke,et al.  WHY LURKERS LURK , 2001 .

[22]  Loren G. Terveen,et al.  Wiki grows up: arbitrary data models, access control, and beyond , 2011, Int. Sym. Wikis.

[23]  S. Epstein.  Cognitive-Experiential Self-Theory of Personality , 2003 .

[24]  Yochai Benkler,et al.  The wealth of networks: how social production transforms markets and freedom , 2006 .

[25]  Loren G. Terveen,et al.  bumpy, caution with merging: an exploration of tagging in a geowiki , 2010, GROUP.

[26]  Mikhil Masli,et al.  Eliciting and focusing geographic volunteer work , 2010, CSCW '10.

[27]  Laura A. Dabbish,et al.  Designing games with a purpose , 2008, CACM.

[28]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[29]  John Riedl,et al.  Creating, destroying, and restoring value in wikipedia , 2007, GROUP.

[30]  Mikhil Masli,et al.  Task Specialization in Social Production Communities: The Case of Geographic Volunteer Work , 2011, ICWSM.

[31]  Karen Zita Haigh,et al.  Exploiting domain geometry in analogical route planning , 1997, J. Exp. Theor. Artif. Intell..

[32]  Eliot R. Smith,et al.  Dual-Process Models in Social and Cognitive Psychology: Conceptual Integration and Links to Underlying Memory Systems , 2000 .

[33]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[34]  Guido Hertel,et al.  Motivation of software developers in Open Source projects: an Internet-based survey of contributors to the Linux kernel , 2003 .

[35]  Aaron Halfaker,et al.  Making peripheral participation legitimate: reader engagement experiments in wikipedia , 2013, CSCW.

[36]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .