Ubiquitous graphics: combining hand-held and wall-size displays to interact with large images

Ubiquitous Graphics addresses the problem of interacting with very large computer graphics images, for instance an online map or a large digitized painting. It uses a combination of mobile and stationary displays to show both overview and detail. The main image is displayed using a projector or other large traditional display. To access details, the user holds a mobile device in front of the stationary display. Using ultrasonic tracking the smaller display is aligned with the overview, giving access to a corresponding portion of the image in higher resolution. Alternatively the system provides "magic lens" functionality that can show additional information. Users may add free-form annotations and pre-defined graphical objects by interacting directly with the mobile device. In a user study, subjects drew better descriptive maps using the system than an ordinary map application. The system is robust and was demonstrated to several thousand people in a week-long public exhibit.