Ubiquitous Access to Unified Messaging: A Study of Usability and the Use of Pervasive Computing

The advent of mobile devices and the wireless Internet is having a profound impact on the way people communicate, as well as on the user interaction paradigms used to access information that was traditionally accessible only through visual interfaces. Applications for mobile devices entail the integration of various data sources optimized for delivery to limited hardware resources and intermittently connected devices through wireless networks. Although telephone interfaces arise as one of the most prominent pervasive applications, they present interaction challenges such as the augmentation of speech recognition through natural language (NL) understanding and high-quality text-to-speech conversion. This article presents an experience in building an automated assistant that is natural to use and could become an alternative to a human assistant. The Mobile Assistant (MA) can read e-mail messages, book appointments, take phone messages, and provide access to personal-organizer information. Key components are a conversational interface, enterprise integration, and notifications tailored to user preferences. The focus of the research has been on supporting the pressing communication needs of mobile workers and overcoming technological hurdles such as achieving high accuracy speech recognition in noisy environments, NL understanding, and optimal message presentation on a variety of devices and modalities. The article outlines findings from the 2 broad field trials and lessons learned regarding the support of mobile workers with pervasive computing devices and emerging technologies.

[1]  Joseph Polifroni,et al.  Organization, communication, and control in the GALAXY-II conversational system , 1999, EUROSPEECH.

[2]  Li Gong,et al.  Shall we mix synthetic speech and human speech?: impact on users' performance, perception, and attitude , 2001, CHI.

[3]  David P. Morgan,et al.  How to build a speech recognition application : a style guide for telephony dialogues , 2001 .

[4]  Nicole Yankelovich,et al.  How do users know what to say? , 1996, INTR.

[5]  Ben Shneiderman,et al.  Designing The User Interface , 2013 .

[6]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[7]  Gaetano Borriello,et al.  Next century challenges: data-centric networking for invisible computing: the Portolano project at the University of Washington , 1999, MobiCom.

[8]  Chris Schmandt Voice communication with computers: conversational systems , 1994 .

[9]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[10]  H. R. J. Grosch,et al.  The Future of Computing , 1958 .

[11]  Martin Helander,et al.  Design Issues for Interfaces using Voice Input , 1997 .

[12]  H. H. Clark Arenas of language use , 1993 .

[13]  Ea-Ee Jan,et al.  The IBM conversational telephony system for financial applications , 1999, EUROSPEECH.

[14]  Randy H. Katz,et al.  Universal Inbox: providing extensible personal mobility and service mobility in an integrated communication network , 2000, Proceedings Third IEEE Workshop on Mobile Computing Systems and Applications.

[15]  Helen J. Wang,et al.  ICEBERG: an Internet core network architecture for integrated communications , 2000, IEEE Wirel. Commun..