Relevance judgments of mobile commercial information

In the age of mobile commerce, users receive floods of commercial messages. How do users judge the relevance of such information? Is their relevance judgment affected by contextual factors, such as location and time? How do message content and contextual factors affect users' privacy concerns? With a focus on mobile ads, we propose a research model based on theories of relevance judgment and mobile marketing research. We suggest topicality, reliability, and economic value as key content factors and location and time as key contextual factors. We found mobile relevance judgment is affected mainly by content factors, whereas privacy concerns are affected by both content and contextual factors. Moreover, topicality and economic value have a synergetic effect that makes a message more relevant. Higher topicality and location precision exacerbate privacy concerns, whereas message reliability alleviates privacy concerns caused by location precision. These findings reveal an interesting intricacy in user relevance judgment and privacy concerns and provide nuanced guidance for the design and delivery of mobile commercial information.

[1]  Patrick Wilson,et al.  Situational relevance , 1973, Inf. Storage Retr..

[2]  Colin J. Bennett,et al.  The Adequacy of Privacy: the European Union Data Protection Directive and the North American Response , 1997, Inf. Soc..

[3]  Richard J. Lutz,et al.  An Empirical Examination of the Structural Antecedents of Attitude toward the Ad in an Advertising Pretesting Context , 1989 .

[4]  Albrecht Schmidt,et al.  There is more to context than location , 1999, Comput. Graph..

[5]  Tumasch Reichenbacher,et al.  The concept of relevance in mobile maps , 2007, Location Based Services and TeleCartography.

[6]  Jonathan Raper.  Geographic relevance , 2007, J. Documentation.

[7]  Birger Hjørland.  The foundation of the concept of relevance , 2009 .

[8]  Linda Schamber,et al.  Users' Criteria for Evaluation in a Multimedia Environment. , 1991 .

[9]  Mary Beth Rosson,et al.  The personalization privacy paradox: An exploratory study of decision making process for location-aware marketing , 2011, Decis. Support Syst..

[10]  Peiling Wang,et al.  A Cognitive Model of Document Use During a Research Project. Study I. Document Selection , 1998, J. Am. Soc. Inf. Sci..

[11]  Khaled Shaalan,et al.  Information Retrieval Technology - 7th Asia Information Retrieval Societies Conference, AIRS 2011, Dubai, United Arab Emirates, December 18-20, 2011. Proceedings , 2011, AIRS.

[12]  Soojung Kim,et al.  Users' relevance criteria for evaluating answers in a social Q&A site , 2009 .

[13]  Gregory D. Abowd,et al.  Towards a Better Understanding of Context and Context-Awareness , 1999, HUC.

[14]  Nicholas J. Belkin,et al.  Characteristics of Texts Affecting Relevance Judgments , 1993 .

[15]  Linda Schamber.  Relevance and Information Behavior. , 1994 .

[16]  Kenneth C. C. Yang,et al.  Factors affecting consumers' responses to mobile advertising from a social norm theoretical perspective , 2010, Telematics Informatics.

[17]  Stuart J. Barnes,et al.  The mobile commerce value chain: analysis and future developments , 2002, Int. J. Inf. Manag..

[18]  Tumasch Reichenbacher,et al.  Mobile Cartography-Adaptive Visualisation of Geographic Informa-tion on Mobile Devices , 2004 .

[19]  Richard T. Watson,et al.  The U-Constructs: Four Information Drives , 2006, Commun. Assoc. Inf. Syst..

[20]  V. Virtanen,et al.  An Empirical Study of the Drivers of Consumer Acceptance of Mobile Advertising , 2007 .

[21]  L. Tiina Sarjakoski,et al.  Need for Context-Aware Topographic Maps in Mobile Devices , 2003, ScanGIS.

[22]  Kai Lung Hui,et al.  Overcoming Online Information Privacy Concerns: An Information-Processing Theory Approach , 2007, J. Manag. Inf. Syst..

[23]  Oliver Günther,et al.  Privacy in e-commerce: stated preferences vs. actual behavior , 2005, CACM.

[24]  Shintaro Okazaki.  How do Japanese consumers perceive wireless ads? A multivariate analysis , 2004 .

[25]  Gordon C. Bruner,et al.  Attitude toward Location-based Advertising , 2007 .

[26]  Anind K. Dey,et al.  Location-Based Services for Mobile Telephony: a Study of Users' Privacy Concerns , 2003, INTERACT.

[27]  Pia Borlund,et al.  The concept of relevance in IR , 2003, J. Assoc. Inf. Sci. Technol..

[28]  Diane H. Sonnenwald,et al.  User perspectives on relevance criteria: A comparison among relevant, partially relevant, and not-relevant judgments , 2002, J. Assoc. Inf. Sci. Technol..

[29]  S. Jarvenpaa,et al.  Exploring the implications of m-commerce for markets and marketing , 2002 .

[30]  Howard Greisdorf,et al.  Relevance thresholds: a multi-stage predictive model of how users evaluate information , 2003, Inf. Process. Manag..

[31]  Joon Koh,et al.  A Comparison of Online Trust Building Factors between Potential Customers and Repeat Customers , 2004, J. Assoc. Inf. Syst..

[32]  Carol L. Barry.  The Identification of User Criteria of Relevance and Document Characteristics: Beyond the Topical Ap , 1993 .

[33]  H. Becker,et al.  The Use of Vignettes in Survey Research , 1978 .

[34]  K. Sahu,et al.  A Re-examination of the , 2001 .

[35]  Yunjie Calvin Xu,et al.  Relevance judgment: What do information users consider beyond topicality? , 2006, J. Assoc. Inf. Sci. Technol..

[36]  Rolph E. Anderson,et al.  Multivariate data analysis (4th ed.): with readings , 1995 .

[37]  Li Yang,et al.  Who will you ask? An empirical study of interpersonal task information seeking , 2006, J. Assoc. Inf. Sci. Technol..

[38]  Peter Ingwersen,et al.  Dimensions of relevance , 2000, Inf. Process. Manag..

[39]  Heikki Karjaluoto,et al.  Factors influencing consumers' willingness to accept mobile advertising: a conceptual model , 2005, Int. J. Mob. Commun..

[40]  Lana K. Brackett,et al.  Cyberspace Advertising vs. Other Media: Consumer vs. Mature Student Attitudes , 2001, Journal of Advertising Research.

[41]  Chia-Hui Chang,et al.  Increasing Broadband Subscriptions for Telecom Carriers through Mobile Advertising , 2011, AIRS.

[42]  Byunghwa Yang,et al.  The integrated mobile advertising model: The effects of technology- and emotion-based evaluations , 2013 .

[43]  Ramnath K. Chellappa,et al.  Personalization versus Privacy: An Empirical Examination of the Online Consumer’s Dilemma , 2005, Inf. Technol. Manag..

[44]  Robert H. Ducoffe.  ADVERTISING VALUE AND ADVERTISING ON THE WEB , 1996 .

[45]  Bert R. Boyce,et al.  Beyond topicality : A two stage view of relevance and the retrieval process , 1982, Inf. Process. Manag..

[46]  Yunjie Calvin Xu,et al.  Novelty and topicality in interactive information retrieval , 2008, J. Assoc. Inf. Sci. Technol..

[47]  Birger Hjørland,et al.  The foundation of the concept of relevance , 2010, J. Assoc. Inf. Sci. Technol..

[48]  SaracevicTefko.  Relevance: A review of the literature and a framework for thinking on the notion in information science. Part III: Behavior and effects of relevance , 2007 .

[49]  Peiling Wang,et al.  A cognitive model of document use during a research project. Study I. document selection , 1998 .

[50]  Süleyman Barutçu,et al.  Attitudes towards mobile marketing tools: A study of Turkish consumers , 2007 .

[51]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[52]  Stefano De Sabbata,et al.  The concept of geographic relevance , 2009 .

[53]  T. Park.  The Nature of Relevance in Information Retrieval: An Empirical Study , 1993, The Library Quarterly.

[54]  Rathindra Sarathy,et al.  Understanding Situational Online Information Disclosure as a Privacy Calculus , 2010, J. Comput. Inf. Syst..

[55]  Tara Matthews,et al.  Location disclosure to social relations: why, when, & what people want to share , 2005, CHI.

[56]  Tefko Saracevic.  Relevance: A review of the literature and a framework for thinking on the notion in information science. Part III: Behavior and effects of relevance , 2007 .

[57]  Michael B. Eisenberg,et al.  A re-examination of relevance: toward a dynamic, situational definition , 1990, Inf. Process. Manag..

[58]  Carol L. Barry.  User-Defined Relevance Criteria: An Exploratory Study , 1994, J. Am. Soc. Inf. Sci..

[59]  S. Halbouni,et al.  An empirical study of the drivers of management accounting innovation: a UAE perspective , 2014 .

[60]  R. Bies,et al.  Consumer Privacy: Balancing Economic and Justice Considerations , 2003 .

[61]  C. Fornell,et al.  Structural Equation Models with Unobservable Variables and Measurement Error: Algebra and Statistics , 1981 .

[62]  Yunjie Calvin Xu,et al.  Relevance judgment in epistemic and hedonic information searches , 2007, J. Assoc. Inf. Sci. Technol..

[63]  Mary Beth Rosson,et al.  Measuring Mobile Users' Concerns for Information Privacy , 2012, ICIS.

[64]  Tefko Saracevic,et al.  RELEVANCE: A review of and a framework for the thinking on the notion in information science , 1997, J. Am. Soc. Inf. Sci..

[65]  SmithH. Jeff,et al.  Information privacy research , 2011 .

[66]  Hal G. Gueutal,et al.  A Field Experiment Comparing Information-Privacy Values, Beliefs, and Attitudes Across Several Types of Organizations , 1983 .

[67]  Julie E. Cohen.  Privacy, Ideology, and Technology: A Response to Jeffrey Rosen , 2001 .

[68]  A. Avramides.  Studies in the Way of Words , 1992 .

[69]  Sanghee Oh,et al.  Users' relevance criteria for evaluating answers in a social Q&A site , 2009, J. Assoc. Inf. Sci. Technol..

[70]  Heng Xu,et al.  Information Privacy Research: An Interdisciplinary Review , 2011, MIS Q..

[71]  Elaine Toms,et al.  Searching for Relevance in the Relevance of Search , 2005, CoLIS.

[72]  Mark S. Ackerman,et al.  Privacy in e-commerce: examining user scenarios and privacy preferences , 1999, EC '99.

[73]  Naresh Kumar Agarwal,et al.  A context-based investigation into source use by information seekers , 2011, J. Assoc. Inf. Sci. Technol..

[74]  Ting Wang,et al.  ANTECEDENTS AND CONSEQUENCES OF MOBILE ADVERTISING INTRUSIVENESS , 2009 .

[75]  Richard J. Rogalski,et al.  A Re-Examination , 1978 .

[76]  Atreyi Kankanhalli,et al.  Task and Social Information Seeking: Whom Do We Prefer and Whom Do We Approach? , 2010, J. Manag. Inf. Syst..

[77]  Yunjie Calvin Xu,et al.  Information Seeking in an Information Systems Project Team , 2010, IEEE Transactions on Professional Communication.

[78]  Paolo Coppola,et al.  The Concept of Relevance in Mobile and Ubiquitous Information Access , 2003, Mobile HCI Workshop on Mobile and Ubiquitous Information Access.

[79]  Stefano De Sabbata,et al.  Criteria of geographic relevance , 2010 .

[80]  Patrick Barwise,et al.  Permission-based mobile advertising , 2002 .

[81]  Yunjie Xu,et al.  Relevance judgment: What do information users consider beyond topicality? , 2006 .

[82]  M. Hyman,et al.  Designing Vignette Studies in Marketing , 2002 .

[83]  Siobhan Chapman.  Logic and Conversation , 2005 .

[84]  Hock-Hai Teo,et al.  The Role of Push-Pull Technology in Privacy Calculus: The Case of Location-Based Services , 2009, J. Manag. Inf. Syst..