Do users write about the system in use?: an investigation from messages in natural language on Twitter

Social Network Sites have grown considerably in recent years. Studies have revealed that users write in Social Systems about services, opinions or facts concerning personal life. However, no studies have been found regarding the following question: Do users write about the system in use? How? Is it valid to evaluate the users experience in Social Network Sites through their written texts? A methodology to search for postings of users on Twitter was used, composed of filters which combine patterns which may be related to the use of the system. The results have shown evidence that some messages posted in these types of systems are about the system in use. As a contribution, we presented some characteristics of the messages of the users of social networking sites in order to facilitate the understanding of its usage experience.

[1]  Yorick Wilks,et al.  Information Extraction: Beyond Document Retrieval , 1998, Int. J. Comput. Linguistics Chin. Lang. Process..

[2]  Tom Gross,et al.  CAESSA: visual authoring of context-aware experience sampling studies , 2011, CHI EA '11.

[3]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[4]  Ian Oakley,et al.  Uses & gratifications of a facebook media sharing group , 2013, CSCW.

[5]  Elizabeth Furtado,et al.  Uma investigação no apoio da avaliação da usabilidade em Sistemas Sociais usando Processamento da Linguagem Natural (An Investigation on the Support of the Usability Evaluation in Social Systems Using Natural Language Processing) [in Portuguese] , 2013, STIL.

[6]  Virpi Roto,et al.  User Experience Evaluation Methods in Academic and Industrial Contexts , 2009 .

[7]  Mizuki Morita,et al.  Twitter Catches The Flu: Detecting Influenza Epidemics using Twitter , 2011, EMNLP.

[8]  Bruce Phillips,et al.  Tracking real-time user experience (TRUE): a comprehensive instrumentation solution for complex systems , 2008, CHI.

[9]  Virpi Roto,et al.  Understanding, scoping and defining user experience: a survey approach , 2009, CHI.

[10]  K. Thompson,et al.  If You're Happy and You Know It , 2012 .

[11]  Sue Jamison-Powell,et al.  "I can't get no sleep": discussing #insomnia on twitter , 2012, CHI.

[12]  Ed H. Chi,et al.  What is a Question? Crowdsourcing Tweet Categorization , 2011 .

[13]  Funda Kivran-Swaine,et al.  Grief-Stricken in a Crowd: The Language of Bereavement and Distress in Social Media , 2012, ICWSM.

[14]  Nigel Bevan,et al.  What is the difference between the purpose of usability and user experience evaluation methods , 2009 .

[15]  Ellen Riloff,et al.  Learning Dictionaries for Information Extraction by Multi-Level Bootstrapping , 1999, AAAI/IAAI.

[16]  Sunny Consolvo,et al.  Using the Experience Sampling Method to Evaluate Ubicomp Applications , 2003, IEEE Pervasive Comput..

[17]  Manfred Tscheligi,et al.  MAESTRO: orchestrating user behavior driven and context triggered experience sampling , 2010, MB '10.

[18]  Julian Brooke,et al.  A SEMANTIC APPROACH TO AUTOMATED TEXT SENTIMENT ANALYSIS , 2009 .

[19]  Maite Taboada,et al.  Lexicon-Based Methods for Sentiment Analysis , 2011, CL.

[20]  Johan Bollen,et al.  Twitter mood predicts the stock market , 2010, J. Comput. Sci..

[21]  Austin Henderson,et al.  Interaction design: beyond human-computer interaction , 2002, UBIQ.

[22]  Michaela Riediger,et al.  Experience Sampling , 2009, SAGE Research Methods Foundations.

[23]  Y. Rogers,et al.  Interaction Design , 2002 .

[24]  Virpi Roto,et al.  User experience evaluation: do you know which method to use? , 2009, CHI Extended Abstracts.

[25]  Kristina Höök,et al.  The sensual evaluation instrument: Developing a trans-cultural self-report measure of affect , 2007, Int. J. Hum. Comput. Stud..

[26]  Kevin Bretonnel Cohen,et al.  1. Introduction to natural language processing , 2014 .

[27]  Guillermo Sapiro,et al.  If you are happy and you know it... tweet , 2012, CIKM '12.

[28]  Diego Reforgiato Recupero,et al.  Sentiment Analysis: Adjectives and Adverbs are Better than Adjectives Alone , 2007, ICWSM.