Trick and Please. A Mixed-Method Study On User Assumptions About the TikTok Algorithm

The short-form video sharing app TikTok is characterized by content-based interactions that largely depend on individually customized video feeds curated by the app’s recommendation algorithm. Algorithms are generally invisible mechanisms within socio-technical systems that can influence how we perceive online and offline reality, and how we interact with each other. Based on experiences from consuming and creating videos, users develop assumptions about how the TikTok algorithm might work, and about how to trick and please the algorithm to make their videos trend so it pushes them to other users’ ‘for you’ pages. We conducted 28 qualitative interviews with TikTok users and identified three main criteria they assume influence the platform’s algorithm: video engagement, posting time, and adding and piling up hashtags. We then collected 300,617 videos from the TikTok trending section and performed a series of data exploration and analysis to test these user assumption by determining criteria for trending videos. Our data analysis confirms that higher video engagement through comments, likes, and shares leads to a higher chance of the algorithm pushing a video to the trending section. We also find that posting videos at certain times increases the chances of it trending and reaching higher popularity. In contrast, the highly common assumption that using trending hashtags, algorithm related hashtags (e.g. #fyp, #foryou), and piling up trending hashtags would significantly push videos to the trending section was found not applicable. Our results contribute to existing research on user understanding of social media algorithms using TikTok as an example for a short-video app that is explicitly built around algorithmic content recommendation. Our results provide a broader perspective on user beliefs and behavior in the context of socio-technical systems and social media content creation and consumption.

[1]  Christian Sandvig,et al.  Algorithmic Authority: the Ethics, Politics, and Economics of Algorithms that Interpret, Decide, and Manage , 2016, CHI Extended Abstracts.

[2]  Jeremy P. Birnholtz,et al.  How People Form Folk Theories of Social Media Feeds and What it Means for How We Study Self-Presentation , 2018, CHI.

[3]  C. Basch,et al.  COVID-19 on TikTok: harnessing an emerging social media platform to convey important public health messages , 2020, International journal of adolescent medicine and health.

[4]  TikTok Synching and performing : body (re)-presentation in the short video app TikTok , 2020 .

[5]  Andrés Segura-Castillo,et al.  Folk theories of algorithmic recommendations on Spotify: Enacting data assemblages in the global South , 2020, Big Data & Society.

[6]  K. Foot,et al.  Media Technologies: Essays on Communication, Materiality, and Society , 2014 .

[7]  Feng Wang,et al.  Understand Instant Video Clip Sharing on Mobile Platforms: Twitter's Vine as a Case Study , 2014, NOSSDAV.

[8]  Qian He,et al.  A study on the characteristics of douyin short videos and implications for edge caching , 2019, ACM TUR-C.

[9]  Lauren Valentino Bryant,et al.  The YouTube Algorithm and the Alt-Right Filter Bubble , 2020, Open Information Science.

[10]  Mike S. Schäfer,et al.  Reposting “till Albert Einstein is TikTok famous”: The Memetic Construction of Science on TikTok , 2020 .

[11]  Ariadna Matamoros-Fernández,et al.  From ranking algorithms to ‘ranking cultures’ , 2018 .

[12]  Emily van der Nagel ‘Networks that work too well’: intervening in algorithmic connections: , 2018 .

[13]  Sean A. Munson,et al.  Unequal Representation and Gender Stereotypes in Image Search Results for Occupations , 2015, CHI.

[14]  Rebecca Gray,et al.  Understanding User Beliefs About Algorithmic Curation in the Facebook News Feed , 2015, CHI.

[15]  Xosé López-García,et al.  Let’s dance the news! How the news media are adapting to the logic of TikTok , 2020, Journalism.

[16]  Nicholas Diakopoulos,et al.  #TulsaFlop: A Case Study of Algorithmically-Influenced Collective Action on TikTok , 2020, ArXiv.

[17]  José van Dijck,et al.  'You have one identity': performing the self on Facebook and LinkedIn , 2013 .

[18]  Cameron Marlow,et al.  Feed me: motivating newcomer contribution in social network sites , 2009, CHI.

[19]  Nicholas Diakopoulos,et al.  Auditing News Curation Systems: A Case Study Examining Algorithmic and Editorial Logic in Apple News , 2019, ICWSM.

[20]  Massimo Airoldi,et al.  Follow the algorithm: an exploratory investigation of music on YouTube , 2016 .

[21]  Karrie Karahalios,et al.  First I "like" it, then I hide it: Folk Theories of Social Feeds , 2016, CHI.

[22]  John Cheney-Lippold,et al.  We Are Data: Algorithms and the Making of Our Digital Selves , 2017 .

[23]  Aliaksandra Shutsko,et al.  User-Generated Short Video Content in Social Media. A Case Study of TikTok , 2020, HCI.

[24]  Orestis Papakyriakopoulos,et al.  Dancing to the Partisan Beat: A First Analysis of Political Communication on TikTok , 2020, WebSci.

[25]  Andrea Forte,et al.  Reliability and Inter-rater Reliability in Qualitative Research , 2019, Proc. ACM Hum. Comput. Interact..

[26]  Daniel Klug "It took me almost 30 minutes to practice this". Performance and Production Practices in Dance Challenge Videos on TikTok , 2020, ArXiv.

[27]  Zhicong Lu,et al.  Exploring TikTok Use and Non-use Practices and Experiences in China , 2020, HCI.

[28]  Jean Burgess,et al.  Mapping sociocultural controversies across digital media platforms: one week of #gamergate on Twitter, YouTube, and Tumblr , 2016 .

[29]  K. Anderson Getting acquainted with social networks and apps: it is time to talk about TikTok , 2020, Library Hi Tech News.

[30]  Michele Willson,et al.  Algorithms (and the) everyday , 2017, The Social Power of Algorithms.

[31]  Sophia Melanson,et al.  We are data: algorithms and the making of our digital selves , 2017 .

[32]  Helen Nissenbaum,et al.  Shaping the Web: Why the Politics of Search Engines Matters , 2000, Inf. Soc..

[33]  Svetlana Yarosh,et al.  Share First, Save Later: Performance of Self through Snapchat Stories , 2017, CHI.

[34]  L. Duncan,et al.  "This is just how I cope": An inductive thematic analysis of eating disorder recovery content created and shared on TikTok using #EDrecovery. , 2020, The International journal of eating disorders.

[35]  Aparajita Bhandari,et al.  TIKTOK AND THE “ALGORITHMIZED SELF”: A NEW MODEL OF ONLINE INTERACTION , 2020 .

[36]  John W. Creswell,et al.  Designing and Conducting Mixed Methods Research , 2006 .

[37]  Wesley De Neve,et al.  The rise of mobile and social short-form video: an in-depth measurement study of vine , 2014 .

[38]  Patrik Wikstrom,et al.  YOU MADE THIS? I MADE THIS: CULTURES OF AUTOMATIC (MIS)ATTRIBUTION ON TIKTOK , 2020, AoIR Selected Papers of Internet Research.

[39]  C. Abidin Mapping Internet Celebrity on TikTok: Exploring Attention Economies and Visibility Labours , 2020, Cultural Science Journal.

[40]  Xing Lu,et al.  Fifteen Seconds of Fame: A Qualitative Study of Douyin, A Short Video Sharing Mobile Application in China , 2019, HCI.

[41]  Ioana Literat,et al.  Youth collective political expression on social media: The role of affordances and memetic dimensions for voicing political views , 2019, New Media Soc..

[42]  K. Karahalios,et al.  "I always assumed that I wasn't really that close to [her]": Reasoning about Invisible Algorithms in News Feeds , 2015, CHI.

[43]  Ruoyuan Gao,et al.  Toward creating a fairer ranking in search engine results , 2020, Inf. Process. Manag..

[44]  Taina Bucher,et al.  Want to be on the top? Algorithmic power and the threat of invisibility on Facebook , 2012, New Media Soc..