The Digital Sommelier: Interacting with Intelligent Products

We present the Digital Sommelier, an interactive wine shopping assistant that provides an intuitive multi-modal interface to general product information as well as to particular attributes of a certain product, such as its current temperature. Wine bottles sense their state via attached wireless sensors and detect user interaction over RFID and acceleration sensors. Visitors can inquire information either through physical interaction with products or a natural language interface. We describe a framework and toolkit for efficient prototyping of sensor based applications as the foundation for the integration of different sensor networks utilized by the sommelier. We further introduce our concept of talking products, an anthropomorphic interaction pattern that allows customers to directly talk to products with personalities.

[1]  Scott Nowson.  The Language of Weblogs: A study of genre and individual differences , 2006 .

[2]  David E. Culler,et al.  Mica: A Wireless Platform for Deeply Embedded Networks , 2002, IEEE Micro.

[3]  Emile H. L. Aarts,et al.  True Visions: The Emergence of Ambient Intelligence , 2008 .

[4]  William H. Burge,et al.  Stream Processing Functions , 1975, IBM J. Res. Dev..

[5]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[6]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[7]  R. McCrae,et al.  An introduction to the five-factor model and its applications. , 1992, Journal of personality.

[8]  Uwe Hansmann,et al.  Pervasive Computing , 2003 .

[9]  Thomas Rist,et al.  Lost in ambient intelligence? , 2004, CHI EA '04.

[10]  Adrian C. North,et al.  The effects of musical and voice “fit” on responses to advertisements , 2004 .

[11]  Ralph Johnson,et al.  design patterns elements of reusable object oriented software , 2019 .

[12]  Marc Schröder,et al.  Expressing vocal effort in concatenative synthesis , 2003 .

[13]  J. Aaker,et al.  Dimensions of Brand Personality , 1997 .

[14]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[15]  Bryan Duggan,et al.  Considerations in the usage of text to speech (TTS) in the creation of natural sounding voice enabled web systems , 2003, ISICT.

[16]  C. Nass,et al.  Truth is beauty: researching embodied conversational agents , 2001 .

[17]  Thomas Rist,et al.  Integrating Models of Personality and Emotions into Lifelike Characters , 1999, IWAI.

[18]  Antonio Krüger,et al.  Integrating Intra and Extra Gestures into a Mobile and Multimodal Shopping Assistant , 2005, Pervasive.

[19]  J. Pennebaker,et al.  Linguistic styles: language use as an individual difference. , 1999, Journal of personality and social psychology.

[20]  Antonio Krüger,et al.  Modelling personality in voices of talking products through prosodic parameters , 2007, IUI '07.

[21]  Wolfgang Wahlster,et al.  The anthropomorphized product shelf: Symmetric multimodal interaction with instrumented environments , 2006 .

[22]  Gregory D. Abowd,et al.  The context toolkit: aiding the development of context-enabled applications , 1999, CHI '99.

[23]  Alastair J. Gill,et al.  Rating e-mail personality at zero acquaintance , 2006 .

[24]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[25]  Tobias Zimmer,et al.  μParts: Low Cost Sensor Networks at Scale , 2005 .

[26]  J. Cassell,et al.  Embodied conversational agents , 2000 .

[27]  Robert Stephens,et al.  A survey of stream processing , 1997, Acta Informatica.

[28]  P. Compton,et al.  A philosophical basis for knowledge acquisition , 1990 .

[29]  Andreas Butz,et al.  Applying the peephole metaphor in a mixed-reality room , 2006, IEEE Computer Graphics and Applications.

[30]  Ian Witten,et al.  Data Mining , 2000 .

[31]  P. Costa,et al.  Normal Personality Assessment in Clinical Practice: The NEO Personality Inventory. , 1992 .

[32]  R. R. Abidin.  Psychological Assessment Resources , 1995 .