A Framework for Mobile Interactions with the Physical World

Mobile interactions with the physical world, meaning a person uses her mobile device as mediator for the interaction with a physical object, get more and more popular in industry and academia. Typical technologies supporting this kind of interactions are Radio Frequency Identification (RFID), visual marker recognition, Near Field Communication (NFC), or Bluetooth. Currently, there only exists very little tool support for building systems that consider this kind of interactions. But this is necessary because of the complexity, variety and distribution of such systems. A framework would also support the development and the dissemination of physical mobile interactions in our everyday live. Therefore we present in this paper the requirements for such tool support, the architecture of the Physical Mobile Interaction Framework (PMIF) and a first version of the implementation.

[1]  Eric Horvitz,et al.  Sensing techniques for mobile interaction , 2000, UIST '00.

[2]  Dorin Comaniciu,et al.  Mobile Interaction with Remote Worlds: The Acoustic Periscope , 2001 .

[3]  Brad A. Myers.  Mobile Devices for Control , 2002, Mobile HCI.

[4]  Albrecht Schmidt,et al.  Multi-Sensor Context-Awareness in Mobile Devices and Smart Artifacts , 2002, Mob. Networks Appl..

[5]  Bill Serra,et al.  People, Places, Things: Web Presence for the Real World , 2002, Mob. Networks Appl..

[6]  Heikki Ailisto,et al.  A user interaction paradigm for physical browsing and near-object control based on tags , 2003 .

[7]  Norbert A. Streitz,et al.  Ambient Displays and Mobile Devices for the Creation of Social Architectural Spaces , 2003 .

[8]  Albrecht Schmidt,et al.  Physical posters as gateways to context-aware services for mobile devices , 2004, Sixth IEEE Workshop on Mobile Computing Systems and Applications.

[9]  Michael Rohs,et al.  USING CAMERA-EQUIPPED MOBILE PHONES FOR INTERACTING WITH REAL-WORLD OBJECTS , 2004 .

[10]  Albrecht Schmidt,et al.  JaGD – An Photo Oriented Learning and Gaming Platform for Mobile Phones , 2005 .

[11]  Oliver Bimber,et al.  PhoneGuide: museum guidance supported by on-device object recognition on mobile phones , 2005, MUM '05.

[12]  Michael Rohs,et al.  Visual code widgets for marker-based interaction , 2005, 25th IEEE International Conference on Distributed Computing Systems Workshops.

[13]  Lucia Terrenghi,et al.  The physical user interface profile (PUIP): modelling mobile interactions with the real world , 2005, TAMODIA '05.

[14]  Keith Cheverst,et al.  Exploring Mobile Phone Interaction with Situated Displays , 2005, PERMID.

[15]  Michael Boyle,et al.  PDAs and shared public displays: Making personal information public, and public information personal , 1999, Personal Technologies.

[16]  Victor Callaghan,et al.  Introducing Personal Operating Spaces for Ubiquitous Computing Environments , 2005, PERMID.

[17]  Albrecht Schmidt,et al.  The rotating compass: a novel interaction technique for mobile navigation , 2005, CHI EA '05.

[18]  Dominik Schmidt,et al.  Using Mobile Phones for Domain Specific Information Appliances , 2005 .

[19]  Rafael Ballagas,et al.  Mobile Phones as Pointing Devices , 2005, PERMID.