"Will Check-in for Badges": Understanding Bias and Misbehavior on Location-Based Social Networks

Social computing researchers are using data from locationbased social networks (LBSN), e.g., “Check-in” traces, as approximations of human movement. Recent work has questioned the validity of this approach, showing large discrepancies between check-in data and actual user mobility. To further validate and understand such discrepancies, we perform a crowdsourced study of Foursquare users that seeks to a) quantify bias and misrepresentation in check-in datasets and the impact of self-selection in prior studies, and b) understand the motivations behind misrepresentation of check-ins, and the potential impact of any system changes designed to curtail such misbehavior. Our results confirm the presence of significant misrepresentation of location check-ins on Foursquare. They also show that while “extraneous” check-ins are motivated by external rewards provided by the system, “missing” check-ins are motivated by personal concerns such as location privacy. Finally, we discuss the broader implications of our findings to the use of check-in datasets in future research on human mobility.

[1]  Cecilia Mascolo,et al.  Where Businesses Thrive: Predicting the Impact of the Olympic Games on Local Retailers through Location-based Services Data , 2014, ICWSM.

[2]  Giovanni Quattrone,et al.  Measuring Urban Deprivation from User Generated Content , 2014, CSCW.

[3]  Michael D. Buhrmester,et al.  Amazon's Mechanical Turk , 2011, Perspectives on psychological science : a journal of the Association for Psychological Science.

[4]  Gang Wang,et al.  On the validity of geosocial mobility traces , 2013, HotNets.

[5]  Jeffrey T. Hancock,et al.  Reading between the lines: linguistic cues to deception in online dating profiles , 2010, CSCW '10.

[6]  Sameer Patil,et al.  "Check out where I am!": location-sharing motivations, preferences, and practices , 2012, CHI Extended Abstracts.

[7]  S. Stouffer Intervening opportunities: a theory relating mobility and distance , 1940 .

[8]  Henriette Cramer,et al.  Representation and communication: challenges in interpreting large social media datasets , 2013, CSCW.

[9]  Cecilia Mascolo,et al.  Exploiting place features in link prediction on location-based social networks , 2011, KDD.

[10]  Aaron D. Shaw,et al.  Social desirability bias and self-reports of motivation: a study of amazon mechanical turk in the US and India , 2012, CHI.

[11]  Cecilia Mascolo,et al.  A Tale of Many Cities: Universal Patterns in Human Urban Mobility , 2011, PloS one.

[12]  Cecilia Mascolo,et al.  NextPlace: A Spatio-temporal Prediction Framework for Pervasive Systems , 2011, Pervasive.

[13]  Reza Shokri,et al.  Predicting Users' Motivations behind Location Check-Ins and Utility Implications of Privacy Protection Mechanisms , 2015, NDSS.

[14]  Shion Guha,et al.  Can you see me now?: location, visibility and the management of impressions on foursquare , 2013, MobileHCI '13.

[15]  Kyumin Lee,et al.  Exploring Millions of Footprints in Location Sharing Services , 2011, ICWSM.

[16]  Cecilia Mascolo,et al.  Evolution of a location-based online social network: analysis and models , 2012, IMC '12.

[17]  Floyd J. Fowler,et al.  Improving Survey Questions: Design and Evaluation , 1995 .

[18]  Siddharth Suri,et al.  Conducting behavioral research on Amazon’s Mechanical Turk , 2010, Behavior research methods.

[19]  Henriette Cramer,et al.  Performing a check-in: emerging practices, norms and 'conflicts' in location-sharing using foursquare , 2011, Mobile HCI.

[20]  Bill Tomlinson,et al.  Who are the crowdworkers?: shifting demographics in mechanical turk , 2010, CHI Extended Abstracts.

[21]  Sameer Patil,et al.  Reasons, rewards, regrets: privacy considerations in location sharing as an interactive practice , 2012, SOUPS.

[22]  Cecilia Mascolo,et al.  Track globally, deliver locally: improving content delivery networks by tracking geographic social cascades , 2011, WWW.

[23]  David A. Maltz,et al.  Dynamic Source Routing in Ad Hoc Wireless Networks , 1994, Mobidata.

[24]  John Zimmerman,et al.  I'm the mayor of my house: examining why people use foursquare - a social-driven location sharing application , 2011, CHI.

[25]  Stefan Dietze,et al.  Understanding Malicious Behavior in Crowdsourcing Platforms: The Case of Online Surveys , 2015, CHI.

[26]  Cecilia Mascolo,et al.  An Empirical Study of Geographic User Activity Patterns in Foursquare , 2011, ICWSM.

[27]  Kevin C. Almeroth,et al.  Towards realistic mobility models for mobile ad hoc networks , 2003, MobiCom '03.

[28]  David R. Musicant,et al.  Barriers to the Localness of Volunteered Geographic Information , 2015, CHI.

[29]  Brent J. Hecht,et al.  A Tale of Cities: Urban Biases in Volunteered Geographic Information , 2014, ICWSM.

[30]  Jure Leskovec,et al.  Friendship and mobility: user movement in location-based social networks , 2011, KDD.