The smart phone: a ubiquitous input device

We show how modern mobile phones (Weiser's tabs) can interact with their environment, especially large situated displays (Weiser's boards). Smart phones' emerging capabilities are fueling a rise in the use of mobile phones as input devices to such resources as situated displays, vending machines, and home appliances. Mobile phones' prevalence gives them great potential to be the default physical interface for ubiquitous computing applications. We survey interaction techniques that use mobile phones as input devices to ubiquitous computing environments. We use smart phone to describe an enhanced mobile phone. Our analysis blurs the line between smart phones and PDAs such as the Palm Pilot because the feature sets continue to converge.

[1]  William Buxton,et al.  Lexical and pragmatic considerations of input structures , 1983, COMG.

[2]  James D. Foley,et al.  The human factors of computer graphics interaction techniques , 1984, IEEE Computer Graphics and Applications.

[3]  Jock D. Mackinlay,et al.  A morphological analysis of the design space of input devices , 1991, TOIS.

[4]  Mark Weiser.  The computer for the 21st century , 1991 .

[5]  Brad A. Myers,et al.  Collaboration using multiple PDAs connected to a PC , 1998, CSCW '98.

[6]  Roy Want,et al.  Bridging physical and virtual worlds with electronic tags , 1999, CHI '99.

[7]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[8]  J. F. Bartlett,et al.  Rock 'n' Scroll Is Here to Stay , 2000 .

[9]  J. Bartlett.  WRL Research Report 2000 / 3 Rock ’ n ’ Scroll is Here to Stay , 2000 .

[10]  I. Scott MacKenzie,et al.  An Isometric Joystick as a Pointing Device for Handheld Information Terminals , 2001, Graphics Interface.

[11]  Dan R. Olsen,et al.  Laser pointer interaction , 2001, CHI.

[12]  Andy Cockburn,et al.  An Evaluation of Mobile Phone Text Input Methods , 2002, AUIC.

[13]  Jeffrey Nichols,et al.  Interacting at a distance: measuring the performance of laser pointers and other devices , 2002, CHI.

[14]  Jeffrey Nichols,et al.  Personal universal controllers: controlling complex appliances with GUIs and speech , 2003, CHI Extended Abstracts.

[15]  Gregory D. Abowd,et al.  A 2-Way Laser-Assisted Selection Scheme for Handhelds in a Physical Environment , 2003, UbiComp.

[16]  Meredith Ringel Morris,et al.  iStuff: a physical user interface toolkit for ubiquitous computing environments , 2003, CHI '03.

[17]  Gregory D. Abowd,et al.  A gesture-based authentication scheme for untrusted public terminals , 2004, UIST '04.

[18]  Michael Rohs,et al.  Real-World Interaction with Camera Phones , 2004, UCS.

[19]  A. Madhavapeddy,et al.  Using Camera-Phones to Enhance Human–Computer Interaction , 2004 .

[20]  Paul A. Beardsley,et al.  RFIG lamps: interacting with a self-describing world via photosensing wireless tags and projectors , 2004, ACM Trans. Graph..

[21]  Suguru Higashino,et al.  C-blink: a hue-difference-based light signal marker for large screen interaction via any mobile terminal , 2004, UIST '04.

[22]  Michael Rohs,et al.  Visual code widgets for marker-based interaction , 2005, 25th IEEE International Conference on Distributed Computing Systems Workshops.

[23]  Michael Rohs,et al.  Sweep and point and shoot: phonecam-based interactions for large public displays , 2005, CHI Extended Abstracts.