Eliciting Touristic Profiles: A User Study on Picture Collections

Eliciting the preferences and needs of tourists is challenging, since people often have difficulties to explicitly express them -- especially in the initial phase of travel planning. Recommender systems employed at the early stage of planning can therefore be very beneficial to the general satisfaction of a user. Previous studies have explored pictures as a tool of communication and as a way to implicitly deduce a traveller's preferences and needs. In this paper, we conduct a user study to verify previous claims and conceptual work on the feasibility of modelling travel interests from a selection of a user's pictures. We utilize fine-tuned convolutional neural networks to compute a vector representation of a picture, where each dimension corresponds to a travel behavioural pattern from the traditional Seven-Factor model. In our study, we followed strict privacy principles and did not save uploaded pictures after computing their vector representation. We aggregate the representations of the pictures of a user into a single user representation, i.e., touristic profile, using different strategies. In our user study with 81 participants, we let users adjust the predicted touristic profile and confirm the usefulness of our approach. Our results show that given a collection of pictures the touristic profile of a user can be determined.

[1]  Linus W. Dietz Designing a Conversational Travel Recommender System Based on Data-Driven Destination Characterization , 2019 .

[2]  Bruce Ferwerda,et al.  Predicting Users' Personality from Instagram Pictures: Using Visual and/or Content Features? , 2018, UMAP.

[3]  F. Maxwell Harper,et al.  User perception of differences in recommender algorithms , 2014, RecSys '14.

[4]  Hannes Werthner,et al.  From Pictures to Travel Characteristics: Deep Learning-Based Profiling of Tourists and Tourism Destinations , 2019 .

[5]  Bruce Ferwerda,et al.  Predicting Personality Traits with Instagram Pictures , 2015, EMPIRE@RecSys.

[6]  Li Chen,et al.  A user-centric evaluation framework for recommender systems , 2011, RecSys '11.

[7]  Francesco Ricci,et al.  E-commerce and tourism , 2004, CACM.

[8]  Nélio Cacho,et al.  From Photos to Travel Itinerary: A Tourism Recommender System for Smart Tourism Destination , 2018, 2018 IEEE Fourth International Conference on Big Data Computing Service and Applications (BigDataService).

[9]  Albert H. Segars,et al.  Exploring the theoretical foundations of playfulness in computer interactions , 2002, Comput. Hum. Behav..

[10]  Lior Rokach,et al.  Recommender Systems: Introduction and Challenges , 2015, Recommender Systems Handbook.

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Pip Forer,et al.  Information Technology and Tourism: A Challenging Relationship , 2002 .

[13]  A. Tellegen,et al.  PERSONALITY PROCESSES AND INDIVIDUAL DIFFERENCES An Alternative "Description of Personality": The Big-Five Factor Structure , 2022 .

[14]  Hannes Werthner,et al.  Information Technology and Tourism — A Challenging Relationship , 1999 .

[15]  Maryam Ramezani,et al.  Matching Recommendation Technologies and Domains , 2011, Recommender Systems Handbook.

[16]  Heather Gibson,et al.  Tourist roles: Needs and the Lifecourse , 2002 .

[17]  I. Deary,et al.  Personality traits, 2nd ed. , 2003 .

[18]  Moni Naor,et al.  Rank aggregation methods for the Web , 2001, WWW '01.

[19]  Andreas H. Zins,et al.  Exploring Travel Information Search Behavior Beyond Common Frontiers , 2007, J. Inf. Technol. Tour..

[20]  Hannes Werthner,et al.  A picture-based approach to recommender systems , 2014, Information Technology & Tourism.

[21]  Hannes Werthner,et al.  What is the “Personality” of a tourism destination? , 2018, Information Technology & Tourism.

[22]  Hannes Werthner,et al.  Eliciting the users' unknown preferences , 2014, RecSys '14.