Handbook of Research on User Interface Design and Evaluation for Mobile Technology

In recent years, mobile technology has been one of the major growth areas in computing. Designing the user interface for mobile applications, however, is a very complex undertaking which is made even more challenging by the rapid technological developments in mobile hardware. Mobile human-computer interaction, unlike desktop-based interaction, must be cognizant of a variety of complex contextual factors affecting both users and technology. The Handbook of Research on User Interface Design and Evaluation provides students, researchers, educators, and practitioners with a compendium of research on the key issues surrounding the design and evaluation of mobile user interfaces, such as the physical environment and social context in which a mobile device is being used and the impact of multitasking behavior typically exhibited by mobile-device users. Compiling the expertise of over 150 leading experts from 26 countries, this exemplary reference tool will make an indispensable addition to every library collection.

[1]  Rick Kazman,et al.  Four Paradigms for Indexing Video Conferences , 1996, IEEE Multim..

[2]  Manfred Tscheligi,et al.  Joking, storytelling, artsharing, expressing affection: a field trial of how children and their social network communicate with digital images in leisure time , 2000, CHI.

[3]  Steve Howard,et al.  Heuristic Evaluation and Mobile Usability: Bridging the Realism Gap , 2004, Mobile HCI.

[4]  Paul A. Beardsley,et al.  RFIG lamps: interacting with a self-describing world via photosensing wireless tags and projectors , 2004, ACM Trans. Graph..

[5]  Thomas S. Huang,et al.  Multimodal Prediction and Classification of Audio-Visual Features , 1998 .

[6]  James A. Landay,et al.  Sketching Interfaces: Toward More Human Interface Design , 2001, Computer.

[7]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[8]  Meredith Ringel Morris,et al.  iStuff: a physical user interface toolkit for ubiquitous computing environments , 2003, CHI '03.

[9]  Marvin Minsky,et al.  A framework for representing knowledge" in the psychology of computer vision , 1975 .

[10]  Li Deng,et al.  Distributed speech processing in miPad's multimodal user interface , 2002, IEEE Trans. Speech Audio Process..

[11]  Alan F. Smeaton,et al.  Mobile access to personal digital photograph archives , 2005, Mobile HCI.

[12]  Bill N. Schilit,et al.  Place Lab: Device Positioning Using Radio Beacons in the Wild , 2005, Pervasive.

[13]  Tiziana Catarci,et al.  Supporting cognitive walkthrough with video data: a mobile learning evaluation study , 2005, Mobile HCI.

[14]  Titti Kallio,et al.  Will Laboratory Test Results be Valid in Mobile Contexts , 2008 .

[15]  I. Scott MacKenzie,et al.  An Isometric Joystick as a Pointing Device for Handheld Information Terminals , 2001, Graphics Interface.

[16]  Rainer Lienhart,et al.  Scene Determination Based on Video and Audio Features , 2004, Multimedia Tools and Applications.

[17]  Minh Tue Vo,et al.  Building an application framework for speech and pen input integration in multimodal learning interfaces , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[18]  Daniel J. Wigdor,et al.  TiltText: using tilt for text input to mobile phones , 2003, UIST '03.

[19]  Mike Flynn,et al.  Browsing Recorded Meetings with Ferret , 2004, MLMI.

[20]  Daniel B. Horn,et al.  Patterns of entry and correction in large vocabulary continuous speech recognition systems , 1999, CHI '99.

[21]  Clayton Lewis,et al.  Key Principles and What Designers Think , 1985 .

[22]  Sharon L. Oviatt,et al.  Error resolution during multimodal human-computer interaction , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[23]  Rafael Ballagas,et al.  REXplorer: a mobile, pervasive spell-casting game for tourists , 2007, CHI Extended Abstracts.

[24]  Clayton Lewis,et al.  Designing for usability—key principles and what designers think , 1983, CHI '83.

[25]  S. McKee,et al.  Spatial configurations for visual hyperacuity , 1977, Vision Research.

[26]  Dong Yu,et al.  Improved name recognition with user modeling , 2003, INTERSPEECH.

[27]  Andy Crabtree,et al.  Ethnography in Participatory Design , 1998 .

[28]  Masood Masoodian,et al.  A Model for Meeting Content Storage and Retrieval , 2005, 11th International Multimedia Modelling Conference.

[29]  J. Bartlett.  WRL Research Report 2000 / 3 Rock ’ n ’ Scroll is Here to Stay , 2000 .

[30]  Dan R. Olsen,et al.  Laser pointer interaction , 2001, CHI.

[31]  Lynn Wilcox,et al.  NoteLook: taking notes in meetings with digital video and ink , 1999, MULTIMEDIA '99.

[32]  Gregory D. Abowd,et al.  Integrating Meeting Capture within a Collaborative Team Environment , 2001, UbiComp.

[33]  Lynn Hasher,et al.  Working Memory, Comprehension, and Aging: A Review and a New View , 1988 .

[34]  H. B. Allen,et al.  A Functional Grammar , 1946 .

[35]  Jakob Nielsen,et al.  Improving System Usability Through Parallel Design , 1996, Computer.

[36]  Masood Masoodian,et al.  An Empirical Study of Textual and Graphical Travel Itinerary Visualization using Mobile Phones , 2003, AUIC.

[37]  Jan Blom,et al.  Contextual and cultural challenges for user mobility research , 2005, CACM.

[38]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[39]  Víctor M. González,et al.  "Constant, constant, multi-tasking craziness": managing multiple working spheres , 2004, CHI.

[40]  Tuuli Mattelmäki,et al.  Mobile probes , 2004, NordiCHI '04.

[41]  Dennis E. Egan,et al.  Individual Differences In Human-Computer Interaction , 1988 .

[42]  Jian Wang,et al.  Integration of eye-gaze, voice and manual response in multimodal user interface , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[43]  Lynne Baillie,et al.  Exploring multimodality in the laboratory and the field , 2005, ICMI '05.

[44]  Steve J. Westerman,et al.  Individual Differences in the Use of Command Line and Menu Computer Interfaces , 1997, Int. J. Hum. Comput. Interact..

[45]  A. Madhavapeddy,et al.  Using Camera-Phones to Enhance Human–Computer Interaction , 2004 .

[46]  Steve Love,et al.  Understanding Mobile Human-Computer Interaction , 2005 .

[47]  R. William Soukoreff,et al.  Text entry for mobile computing: models and methods , 2002 .

[48]  Jeffrey Nichols,et al.  Interacting at a distance: measuring the performance of laser pointers and other devices , 2002, CHI.

[49]  William Buxton,et al.  Lexical and pragmatic considerations of input structures , 1983, COMG.

[50]  Hagen Soltau,et al.  Advances in automatic meeting record creation and access , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[51]  Connor Graham,et al.  A Review of Mobile HCI Research Methods , 2003, Mobile HCI.

[52]  Andreas Stolcke,et al.  The Meeting Project at ICSI , 2001, HLT.

[53]  Marc Rettig,et al.  Prototyping for tiny fingers , 1994, CACM.

[54]  James A. Landay,et al.  NotePals: lightweight note sharing by the group, for the group , 1999, CHI '99.

[55]  Aaron E. Rosenberg,et al.  SCANMail: a voicemail interface that makes speech browsable, readable and searchable , 2002, CHI.

[56]  Masood Masoodian,et al.  Gathering a corpus of multimodal computer-mediated meetings , 2006, LREC.

[57]  Saturnino Luz.  INTERLEAVE FACTOR AND MULTIMEDIA INFORMATION VISUALISATION , 2002 .

[58]  Alan F. Smeaton,et al.  MediAssist: Using Content-Based Analysis and Context to Manage Personal Photo Collections , 2006, CIVR.

[59]  Christophe Beaugeant,et al.  ASR in mobile phones - an industrial approach , 2002, IEEE Trans. Speech Audio Process..

[60]  Sharon L. Oviatt,et al.  Multimodal Integration - A Statistical View , 1999, IEEE Trans. Multim..

[61]  David G. Stork,et al.  Speechreading by Humans and Machines , 1996 .

[62]  Kerry Rodden.  How Do People Organise Their Photographs? , 1999, BCS-IRSG Annual Colloquium on IR Research.

[63]  Yang Li,et al.  Topiary: a tool for prototyping location-enhanced applications , 2004, UIST '04.

[64]  Michael Picheny,et al.  Influence of background noise and microphone on the performance of the IBM Tangora speech recognition system , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[65]  Tonya L. Smith-Jackson,et al.  Systematic evaluation methodology for cell phone user interfaces , 2006, Interact. Comput..

[66]  Yuxiao Hu,et al.  Efficient propagation for face annotation in family albums , 2004, MULTIMEDIA '04.

[67]  S. Kristoffersen,et al.  Mobile Use of IT , 1999 .

[68]  Brian P. Bailey,et al.  DEMAIS: designing multimedia applications with interactive storyboards , 2001, MULTIMEDIA '01.

[69]  Sharon L. Oviatt,et al.  Ten myths of multimodal interaction , 1999, Commun. ACM.

[70]  David V. Anderson,et al.  Towards Low-Power On-chip Auditory Processing , 2005, EURASIP J. Adv. Signal Process..

[71]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[72]  Mark H. Chignell,et al.  Mobile text entry: relationship between walking speed and text input task difficulty , 2005, Mobile HCI.

[73]  Arne Jönsson,et al.  Wizard of Oz studies: why and how , 1993, IUI '93.

[74]  James D. Foley,et al.  The human factors of computer graphics interaction techniques , 1984, IEEE Computer Graphics and Applications.

[75]  Dong Yu,et al.  N-Gram Based Filler Model for Robust Grammar Authoring , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[76]  Leysia Palen,et al.  Going wireless: behavior & practice of new mobile phone users , 2000, CSCW '00.

[77]  Catherine Plaisant,et al.  Navigation patterns and usability of zoomable user interfaces with and without an overview , 2002, TCHI.

[78]  E. Diener,et al.  Experience Sampling: Promises and Pitfalls, Strengths and Weaknesses , 2003 .

[79]  Graham I. Johnson,et al.  Evaluating usability of human computer interfaces: a practical method (west sussex , 1989 .

[80]  Christian Licoppe,et al.  Emergent Uses of a Multiplayer Location‐aware Mobile Game: the Interactional Consequences of Mediated Encounters , 2006 .

[81]  Li Deng,et al.  Mipad: a next generation PDA prototype , 2000, INTERSPEECH.

[82]  A. Lancaster,et al.  Paper Prototyping: The Fast and Easy Way to Design and Refine User Interfaces , 2004, IEEE Transactions on Professional Communication.

[83]  Shumin Zhai,et al.  Camera phone based motion sensing: interaction techniques, applications and performance study , 2006, UIST.

[84]  Tiecheng Liu,et al.  Real-time content analysis and adaptive transmission of lecture videos for mobile applications , 2004, MULTIMEDIA '04.

[85]  Gregory D. Abowd,et al.  Farther Than You May Think: An Empirical Investigation of the Proximity of Users to Their Mobile Phones , 2006, UbiComp.

[86]  Jakob Nielsen,et al.  Usability inspection methods , 1994, CHI 95 Conference Companion.

[87]  Constance F. Citro,et al.  Protecting participants and facilitating social and behavioral sciences research , 2003 .

[88]  Marc Davis,et al.  Metadata creation system for mobile images , 2004, MobiSys '04.

[89]  Hanqing Lu,et al.  Providing on-demand sports video to mobile devices , 2005, MULTIMEDIA '05.

[90]  Kent Larson,et al.  Tools for Studying Behavior and Technology in Natural Settings , 2003, UbiComp.

[91]  Jesper Kjeldskov,et al.  Is It Worth the Hassle? Exploring the Added Value of Evaluating the Usability of Context-Aware Mobile Systems in the Field , 2004, Mobile HCI.

[92]  Ye-Yi Wang,et al.  Is word error rate a good indicator for spoken language understanding accuracy , 2003, 2003 IEEE Workshop on Automatic Speech Recognition and Understanding (IEEE Cat. No.03EX721).

[93]  Michael Rohs,et al.  Real-World Interaction with Camera Phones , 2004, UCS.

[94]  Anoop K. Sinha,et al.  Suede: a Wizard of Oz prototyping tool for speech user interfaces , 2000, UIST '00.

[95]  Stuart K. Card,et al.  Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys, for text selection on a CRT , 1987 .

[96]  A. Waibel,et al.  MULTIMODAL INTERPRETER SPEECH GESTURE WRITING DIALOG PROCESSOR MULTIMODAL LEARNING INTERFACES , 1995 .

[97]  Simon P. Davies,et al.  Knowledge restructuring and the acquisition of programming expertise , 1994, Int. J. Hum. Comput. Stud..

[98]  Xiang Cao,et al.  VisionWand: interaction techniques for large displays using a passive wand tracked in 3D , 2003, UIST '03.

[99]  Dong Yu,et al.  A Speech-Centric Perspective for Human-Computer Interface: A Case Study , 2005, J. VLSI Signal Process..

[100]  Henrique S. Malvar,et al.  A new beamformer design algorithm for microphone arrays , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[101]  Ben Shneiderman,et al.  Motivating Annotation for Digital Photographs: Lowering Barriers While Raising Incentives (2004) , 2005 .

[102]  Denis Jouvet,et al.  Evaluation of a noise-robust DSR front-end on Aurora databases , 2002, INTERSPEECH.

[103]  Andrew Zisserman,et al.  Object Level Grouping for Video Shots , 2004, International Journal of Computer Vision.

[104]  Lynn Wilcox,et al.  MiniMedia surfer: browsing video segments on small displays , 2004, CHI EA '04.

[105]  Kerry Rodden,et al.  How do people manage their digital photographs? , 2003, CHI '03.

[106]  Kuansan Wang,et al.  A detection based approach to robust speech understanding , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[107]  Ling Bao,et al.  A context-aware experience sampling tool , 2003, CHI Extended Abstracts.

[108]  Michael Rohs,et al.  Visual code widgets for marker-based interaction , 2005, 25th IEEE International Conference on Distributed Computing Systems Workshops.

[109]  Kerry Rodden,et al.  Evaluating similarity-based visualisations as interfaces for image browsing , 2002 .

[110]  David R. Morse,et al.  Using while moving: HCI issues in fieldwork environments , 2000, TCHI.

[111]  David Akers,et al.  CINCH: a cooperatively designed marking interface for 3D pathway selection , 2006, UIST.

[112]  Anees Shaikh,et al.  An Architecture for Multimodal Information Fusion , 1997 .

[113]  Greg Turk,et al.  Interactive simulation in a multi-person virtual world , 1992, CHI.

[114]  Michael Rohs,et al.  The smart phone: a ubiquitous input device , 2006, IEEE Pervasive Computing.

[115]  Walter de Abreu Cybis,et al.  Usability Testing of Mobile Devices: A Comparison of Three Approaches , 2005, INTERACT.

[116]  D. Norman,et al.  User Centered System Design: New Perspectives on Human-Computer Interaction , 1988 .

[117]  Peter G. B. Enser.  Pictorial information retrieval , 1995 .

[118]  Michael Rohs,et al.  Sweep and point and shoot: phonecam-based interactions for large public displays , 2005, CHI Extended Abstracts.

[119]  John R. Smith,et al.  Large-scale concept ontology for multimedia , 2006, IEEE MultiMedia.

[120]  Antti Oulasvirta,et al.  Building social discourse around mobile photos: a systemic perspective , 2005, Mobile HCI.

[121]  Abigail Sellen,et al.  The ubiquitous camera: an in-depth study of camera phone use , 2005, IEEE Pervasive Computing.

[122]  Masood Masoodian,et al.  RECOLED: A group-aware collaborative text editor for capturing document history , 2005 .

[123]  Philip R. Cohen,et al.  QuickSet: multimodal interaction for distributed applications , 1997, MULTIMEDIA '97.

[124]  Allison Druin,et al.  Technology probes: inspiring design for and with families , 2003, CHI '03.

[125]  K. A. Ericsson,et al.  Verbal reports as data. , 1980 .

[126]  Brad A. Myers,et al.  Collaboration using multiple PDAs connected to a PC , 1998, CSCW '98.

[127]  Masood Masoodian,et al.  Visualization of Travel Itinerary Information on PDAs , 2004, AUIC.

[128]  S. Sivadas,et al.  Short message dictation on Symbian series 60 mobile phones , 2006, ICMI '06.

[129]  Stefanie Tellex,et al.  An Audio-Based Personal Memory Aid , 2004, UbiComp.

[130]  Allan Kuchinsky,et al.  Requirements for photoware , 2002, CSCW '02.

[131]  Philip R. Cohen,et al.  Synergistic use of direct manipulation and natural language , 1989, CHI '89.

[132]  Laila Dybkjær,et al.  Usability Evaluation in Spoken Language Dialogue Systems , 2001, ACL 2001.

[133]  Jesper Simonsen,et al.  Using ethnography in contextural design , 1997, CACM.

[134]  Kenton O'Hara,et al.  Public and Situated Displays: Social and Interactional Aspects of Shared Display Technologies , 2004 .

[135]  Thomas Rist,et al.  Customizing Graphics for Tiny Displays of Mobile Devices , 2002, Personal and Ubiquitous Computing.

[136]  Blair MacIntyre,et al.  DART: a toolkit for rapid design exploration of augmented reality experiences , 2005, ACM Trans. Graph..

[137]  Mark W. Newman,et al.  DENIM: finding a tighter fit between tools and practice for Web site design , 2000, CHI.

[138]  David R. Millen,et al.  Rapid ethnography: time deepening strategies for HCI field research , 2000, DIS '00.

[139]  Michael S. Bernstein,et al.  Reflective physical prototyping through integrated design, test, and analysis , 2006, UIST.

[140]  Steinar Kristoffersen,et al.  Moving out of the meeting room: Exploring support for mobile meetings , 1999, ECSCW.

[141]  Leysia Palen,et al.  Beyond the handset: designing for wireless communications usability , 2002, TCHI.

[142]  Yifan Gong,et al.  Speech recognition in noisy environments: A survey , 1995, Speech Commun..

[143]  Suguru Higashino,et al.  C-blink: a hue-difference-based light signal marker for large screen interaction via any mobile terminal , 2004, UIST '04.

[144]  I. Scott MacKenzie,et al.  Text Entry for Mobile Computing: Models and Methods,Theory and Practice , 2002, Hum. Comput. Interact..

[145]  Xing Xie,et al.  Photo-to-search: using multimodal queries to search the web from mobile devices , 2005, MIR '05.

[146]  Matt Jones,et al.  Mobile Interaction Design , 2006 .

[147]  E. Goffman.  Behavior in Public Places , 1963 .

[148]  Xiao Li,et al.  A high-speed, low-resource ASR back-end based on custom arithmetic , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[149]  Gregory D. Abowd,et al.  Making multimedia meeting records more meaningful , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[150]  Li Deng,et al.  MiPad: a multimodal interaction prototype , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[151]  Vladimir Pavlovic,et al.  Integration of audio/visual information for use in human-computer intelligent interaction , 1997, Proceedings of International Conference on Image Processing.

[152]  Antti Oulasvirta,et al.  Understanding mobile contexts , 2003, Personal and Ubiquitous Computing.

[153]  Ben Shneiderman,et al.  LifeLines: visualizing personal histories , 1996, CHI.

[154]  Robert Graham,et al.  Subjective assessment of speech-system interface usability , 2001, INTERSPEECH.

[155]  Masood Masoodian,et al.  Visualisation of Meeting Records on Mobile Devices , 2008 .

[156]  Virpi Roto,et al.  Examining mobile phone use in the wild with quasi-experimentation , 2004 .

[157]  Eric Horvitz,et al.  Principles of mixed-initiative user interfaces , 1999, CHI '99.

[158]  Bernhard Suhm,et al.  Multimodal interactive error recovery for non-conversational speech user interfaces , 1999 .

[159]  Stephen A. Brewster,et al.  Using Landmarks to Support Older People in Navigation , 2004, Mobile HCI.

[160]  Jeffrey Nichols,et al.  Controlling Home and Office Appliances with Smart Phones , 2006, IEEE Pervasive Computing.

[161]  Koichi Mori,et al.  An Empirical Study of the Minimum Required Size and the Minimum Number of Targets for Pen Input on the Small Display , 2002, Mobile HCI.

[162]  WixonDennis.  Evaluating usability methods , 2003 .

[163]  Gregory D. Abowd,et al.  A gesture-based authentication scheme for untrusted public terminals , 2004, UIST '04.

[164]  Saturnino Luz,et al.  Meeting browser: a system for visualising and accessing audio in multicast meetings , 1999, 1999 IEEE Third Workshop on Multimedia Signal Processing (Cat. No.99TH8451).

[165]  Jay G. Wilpon,et al.  Voice communication between humans and machines , 1994 .

[166]  Gregory D. Abowd,et al.  Lessons learned from eClass: Assessing automated capture and access in the classroom , 2004, TCHI.

[167]  Paul Dourish,et al.  What we talk about when we talk about context , 2004, Personal and Ubiquitous Computing.

[168]  Thomas S. Huang,et al.  Factor graph framework for semantic video indexing , 2002, IEEE Trans. Circuits Syst. Video Technol..

[169]  William W. Gaver,et al.  Design: Cultural probes , 1999, INTR.

[170]  Leysia Palen,et al.  “I'll get that off the audio”: a case study of salvaging multimedia meeting records , 1997, CHI.

[171]  Edward R. Tufte,et al.  The Visual Display of Quantitative Information , 1986 .

[172]  Marc Davis,et al.  The uses of personal networked digital imaging: an empirical study of cameraphone photos and sharing , 2005, CHI Extended Abstracts.

[173]  Adam Cheyer,et al.  Multimodal Maps: An Agent-Based Approach , 1995, Multimodal Human-Computer Communication.

[174]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.

[175]  Mary Czerwinski,et al.  DateLens: A fisheye calendar interface for PDAs , 2004, TCHI.

[176]  Paul H. Dietz,et al.  Real-time audio buffering for telephone applications , 2001, UIST '01.

[177]  Savitha Srinivasan,et al.  Information Retrieval Techniques for Speech Applications , 2002, Lecture Notes in Computer Science.

[178]  Oscar de Bruijn,et al.  Rapid serial visual presentation: a space-time trade-off in information presentation , 2000, AVI '00.

[179]  Stephen A. Brewster,et al.  A paradigm shift: alternative interaction techniques for use with mobile & wearable devices , 2003, CASCON.

[180]  Harald Reiterer,et al.  Usability of overview-supported zooming on small screens with regard to individual differences in spatial ability , 2006, AVI '06.

[181]  Xing Xie,et al.  AIRE: an ambient interactive and responsive environment for mobile image management , 2005, Mobile HCI.

[182]  L. Faulkner.  Beyond the five-user assumption: Benefits of increased sample sizes in usability testing , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[183]  Masood Masoodian,et al.  Supporting Remote Collaboration Through Structured Activity Logging , 2005, GCC.

[184]  Kentaro Toyama,et al.  Geographic location tags on digital images , 2003, ACM Multimedia.

[185]  Luca Chittaro,et al.  Visualizing information on mobile devices , 2006, Computer.

[186]  Matt Jones,et al.  An Evaluation of Techniques for Browsing Photograph Collections on Small Displays , 2004, Mobile HCI.

[187]  Eric Horvitz,et al.  Toward more sensitive mobile phones , 2001, UIST '01.

[188]  Jonathon S. Hare,et al.  Mind the gap: another look at the problem of the semantic gap in image retrieval , 2006, Electronic Imaging.

[189]  Martina Ziefle,et al.  Children Using Cellular Phones: The Effects of Shortcomings in User Interface Design , 2005, Hum. Factors.

[190]  Andreas Butz,et al.  Location-Aware Shopping Assistance: Evaluation of a Decision-Theoretic Approach , 2002, Mobile HCI.

[191]  Stephen W. Smoliar,et al.  Video parsing and browsing using compressed data , 1995, Multimedia Tools and Applications.

[192]  Jérôme Boudy,et al.  Experiments with a nonlinear spectral subtractor (NSS), Hidden Markov models and the projection, for robust speech recognition in cars , 1991, Speech Commun..

[193]  Tuuli Mattelmäki,et al.  Observing and probing , 2003, DPPI '03.

[194]  Marc Davis,et al.  Photo annotation on a camera phone , 2004, CHI EA '04.

[195]  James A. Larson,et al.  Guidelines for multimodal user interface design , 2004, CACM.

[196]  Giovanni Iachello,et al.  Privacy and Proportionality , 2006 .

[197]  Yasuhito Suenaga,et al.  "Finger-Pointer": Pointing interface by image processing , 1994, Comput. Graph..

[198]  Michael Johnston,et al.  Unification-based Multimodal Parsing , 1998, ACL.

[199]  Berna Erol,et al.  Multimodal summarization of meeting recordings , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[200]  Jakob Nielsen,et al.  Iterative user-interface design , 1993, Computer.

[201]  Masood Masoodian,et al.  A mobile system for non-linear access to time-based data , 2004, AVI.

[202]  George Buchanan,et al.  Improving Web Interaction on Small Displays , 1999, Comput. Networks.

[203]  Andreas Girgensohn,et al.  LiteMinutes: an Internet-based system for multimedia meeting minutes , 2001, WWW '01.

[204]  Daniel J. Wigdor,et al.  A comparison of consecutive and concurrent input text entry techniques for mobile phones , 2004, CHI.

[205]  Mikael Wiberg.  RoamWare: an integrated architecture for seamless interaction in between mobile meetings , 2001, GROUP '01.

[206]  Oscar de Bruijn,et al.  RSVP Browser: Web Browsing on Small Screen Devices , 2001, Personal and Ubiquitous Computing.

[207]  Wolfgang Effelsberg,et al.  Scene Determination Based on Video and Audio Features , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[208]  Alexander H. Waibel,et al.  Improving connected letter recognition by lipreading , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[209]  Alan F. Smeaton,et al.  Interactive Experiments in Object-Based Retrieval , 2006, CIVR.

[210]  Xiaoyi Ma,et al.  Eliciting user preferences using image-based experience sampling and reflection , 2002, CHI Extended Abstracts.

[211]  H. Zelaznik,et al.  Motor-output variability: a theory for the accuracy of rapid motor acts. , 1979, Psychological review.

[212]  Roy Want,et al.  Bridging physical and virtual worlds with electronic tags , 1999, CHI '99.

[213]  James F. Allen.  Towards a General Theory of Action and Time , 1984, Artif. Intell..

[214]  Antonella De Angeli,et al.  Integration and synchronization of input modes during multimodal human-computer interaction , 1997, CHI.

[215]  Martina Ziefle,et al.  Barriers of Information Access in Small Screen Device Applications: The Relevance of User Characteristics for a Transgenerational Design , 2006, Universal Access in Ambient Intelligence Environments.

[216]  T. Busch.  Gender Differences in Self-Efficacy and Attitudes toward Computers , 1995 .

[217]  Patrick Baudisch,et al.  Summary thumbnails: readable overviews for small screen web browsers , 2005, CHI.

[218]  Martina Ziefle,et al.  Understanding age differences in PDA acceptance and performance , 2007, Comput. Hum. Behav..

[219]  George Buchanan,et al.  Sorting Out Searching on Small Screen Devices , 2002, Mobile HCI.

[220]  Ted Boren,et al.  Thinking aloud: reconciling theory and practice , 2000 .

[221]  David G. Schwartz.  Cooperating heterogeneous systems: a blackboard-based meta approach , 1993 .

[222]  Jock D. Mackinlay,et al.  A morphological analysis of the design space of input devices , 1991, TOIS.

[223]  Dragutin Petkovic,et al.  Content-Based Representation and Retrieval of Visual Media: A State-of-the-Art Review , 1996 .

[224]  Dana Chisnell,et al.  Handbook of Usability Testing , 2009 .

[225]  Xing Xie,et al.  MobiPicture: browsing pictures on mobile devices , 2003, MULTIMEDIA '03.

[226]  Philip R. Cohen,et al.  Towards a fault-tolerant multi-agent system architecture , 2000, AGENTS '00.

[227]  Mikael Wiberg.  Bridging physical and virtual group meetings with a PC and multiple hand-held devices , 2000, CHI Extended Abstracts.

[228]  Steve Whittaker,et al.  A meeting browser evaluation test , 2005, CHI Extended Abstracts.

[229]  L. Wheeler,et al.  Self‐Recording of Everyday Life Events: Origins, Types, and Uses , 1991 .

[230]  Martina Ziefle,et al.  15 Cross platform consistency and cognitive compatibility: the importance of users' mental model for the interaction with mobile devices , 2006 .

[231]  Alexander H. Waibel,et al.  Modeling focus of attention for meeting indexing , 1999, MULTIMEDIA '99.

[232]  Masood Masoodian,et al.  Lecture capture using large interactive display systems , 2002, International Conference on Computers in Education, 2002. Proceedings..

[233]  Steven W. Brown,et al.  The effects and interaction of spatial visualization and domain expertise on information seeking , 2004, Comput. Hum. Behav..

[234]  Ye-Yi Wang.  Robust language understanding in mipad , 2001, INTERSPEECH.

[235]  Beverly L. Harrison,et al.  Timelines: An Interactive System for the Collection and Visualization of Temporal Data , 1994 .

[236]  Hao Jiang,et al.  Direct pointer: direct manipulation for large-display interaction using handheld cameras , 2006, CHI.

[237]  Masood Masoodian,et al.  A mobile tool for browsing recorded collaborative meeting contents , 2003, CHINZ '03.

[238]  D M Levi,et al.  Spatial alignment across gaps: contributions of orientation and spatial scale. , 1995, Journal of the Optical Society of America. A, Optics, image science, and vision.

[239]  Thomas G. Holzman.  Computer-human interface solutions for emergency medical care , 1999, INTR.

[240]  Minna Isomursu,et al.  Experience clip: method for user participation and evaluation of mobile concepts , 2004, PDC 04.

[241]  Masatoshi Ishikawa,et al.  Smart laser-scanner for 3D human-machine interface , 2005, CHI EA '05.

[242]  F. N. Shemyakin.  Orientation in space , 1962 .

[243]  M. Naaman,et al.  Lost in memories: interacting with photo collections on PDAs , 2004, Proceedings of the 2004 Joint ACM/IEEE Conference on Digital Libraries, 2004..

[244]  Roy Want,et al.  Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces , 1998, CHI.

[245]  Kenton O'Hara,et al.  Dealing with mobility: understanding access anytime, anywhere , 2001, TCHI.

[246]  Debby Hindus,et al.  Ubiquitous audio: capturing spontaneous collaboration , 1992, CSCW '92.

[247]  Brad A. Myers,et al.  Past, Present and Future of User Interface Software Tools , 2000, TCHI.

[248]  Henry Been-Lirn Duh,et al.  Usability evaluation for mobile device: a comparison of laboratory and field tests , 2006, Mobile HCI.

[249]  Martina Ziefle,et al.  Mental Models of a Cellular Phone Menu. Comparing Older and Younger Novice Users , 2004, Mobile HCI.

[250]  Mark Perry,et al.  Dealing with mobile conversations in public places: some implications for the design of socially intrusive technologies , 2004, CHI EA '04.

[251]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[252]  J. F. Bartlett,et al.  Rock 'n' Scroll Is Here to Stay , 2000 .

[253]  Mark Weiser.  The computer for the 21st century , 1991 .

[254]  P R Cohen,et al.  The role of voice input for human-machine communication. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[255]  Steve Whittaker,et al.  Accessing Multimodal Meeting Data: Systems, Problems and Possibilities , 2004, MLMI.

[256]  Virpi Roto,et al.  Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI , 2005, CHI.

[257]  Barry Arons,et al.  SpeechSkimmer: interactively skimming recorded speech , 1993, UIST '93.

[258]  Vibha Sazawal,et al.  TiltType: accelerometer-supported text entry for very small devices , 2002, UIST '02.

[259]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[260]  Sharon L. Oviatt,et al.  Integration themes in multimodal human-computer interaction , 1994, ICSLP.

[261]  David Harel,et al.  Statecharts: A Visual Formalism for Complex Systems , 1987, Sci. Comput. Program..

[262]  Alan F. Smeaton,et al.  Mobile Access to the Físchlár-News Archive , 2003, Mobile HCI Workshop on Mobile and Ubiquitous Information Access.

[263]  George Buchanan,et al.  Improving web search on small screen devices , 2003, Interact. Comput..

[264]  Yi Wu,et al.  Ontology-based multi-classification learning for video concept detection , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[265]  F. Zwicky,et al.  The Morphological Approach to Discovery, Invention, Research and Construction , 1967 .

[266]  Gregory D. Abowd,et al.  The Personal Audio Loop: Designing a Ubiquitous Audio-Based Memory Aid , 2004, Mobile HCI.

[267]  Wolfgang Hürst,et al.  Indexing, searching, and skimming of multimedia documents containing recorded lectures and live presentations , 2003, ACM Multimedia.

[268]  Tom Rodden,et al.  Probing the Probes , 2002 .

[269]  Hanhwe Kim,et al.  Spatial metaphors and disorientation in hypertext browsing , 1995, Behav. Inf. Technol..

[270]  Elizabeth F. Churchill,et al.  Digital graffiti: public annotation of multimedia content , 2004, CHI EA '04.

[271]  Mary Czerwinski,et al.  A diary study of task switching and interruptions , 2004, CHI.

[272]  Gregory D. Abowd,et al.  A 2-Way Laser-Assisted Selection Scheme for Handhelds in a Physical Environment , 2003, UbiComp.

[273]  L. F. Barrett,et al.  A Practical Guide to Experience-Sampling Procedures , 2003 .

[274]  Blair MacIntyre,et al.  DART: a toolkit for rapid design exploration of augmented reality experiences , 2004, UIST '04.

[275]  Jonathan Foote,et al.  An overview of audio information retrieval , 1999, Multimedia Systems.

[276]  Johanna D. Moore,et al.  Proceedings of the Conference on Human Factors in Computing Systems , 1989 .

[277]  Sunny Consolvo,et al.  Using the Experience Sampling Method to Evaluate Ubicomp Applications , 2003, IEEE Pervasive Comput..

[278]  J. Hughes,et al.  Designing with Care: Adapting Cultural Probes to Inform Design in Sensitive Settings , 2003 .

[279]  Anu Kankainen,et al.  Usability testing of mobile applications: a comparison between laboratory and field testing , 2005 .