Gesturemote: interacting with remote displays through touch gestures

We present Gesturemote, a technique for interacting with remote displays through touch gestures on a handheld touch surface. By combining a variety of different touch gestures and connecting them smoothly, Gesturemote supports a wide range of interaction behaviors, from low pixel-level interaction such as pointing and clicking, to medium-level interaction such as structured navigation of a user interface, to high-level interaction such as invoking a function directly (e.g. shortcuts). Gesturemote requires no visual attention to use and thus is eyes-free. We received positive initial feedback for Gesturemote from the participants in an interview where we walked them through the design. In addition, we investigated the usability of our gesture-based target acquisition technique by comparing it with a trackpad in a target acquisition task. The results indicate that Gesturemote performs better when visual search is required and is preferable to a general-purpose trackpad.