Large document, small screen: a camera driven scroll and zoom control for mobile devices

We present a three degree-of-freedom control designed for viewing large documents and images on a mobile device equipped with a camera. Tracking natural features detected in the camera's field of view, we can roughly estimate the motion of the device, using the results to scroll and zoom the current document. Central to our implementation is the manner by which we amplify the motion, allowing the user to scroll through large portions of the document with minimal hand movement. Then, using a Hidden Markov Model, we determine when the user is scrolling, zooming, or some combination of the two, thus providing smoother, more fluid control. We demonstrate a prototype of our 3DOF control that can easily navigate documents that are many times larger than the display area, and show how it might be incorporated into a larger document retrieval application.

[1]  Michael Rohs,et al.  Which one is better?: information navigation techniques for spatially aware handheld displays , 2006, ICMI '06.

[2]  Vidya Setlur,et al.  Camera-Based Virtual Environment Interaction on Mobile Devices , 2006, ISCIS.

[3]  Suya You,et al.  Real-Time Object Tracking for Augmented Reality Combining Graph Cuts and Optical Flow , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[4]  AH KUN,et al.  Enhancing Map Viewing on Symbian Series 60 Smartphones using Camera as 2 D Input Device , 2005 .

[5]  Xu Liu,et al.  Fast camera motion estimation for hand-held devices and applications , 2005, MUM '05.

[6]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[7]  George W. Fitzmaurice,et al.  Situated information spaces and spatially aware palmtop computers , 1993, CACM.

[8]  Michael Rohs,et al.  CaMus2: optical flow and collaboration in camera phone music performance , 2007, NIME '07.

[9]  Gerard Jounghyun Kim,et al.  Interaction techniques in large display environments using hand-held devices , 2006, VRST '06.

[10]  Joachim Pouderoux,et al.  A camera-based interface for interaction with mobile handheld computers , 2005, I3D '05.

[11]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[12]  John F. Canny,et al.  TinyMotion: camera phone based interaction methods , 2006, CHI EA '06.

[13]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Yasuhiro Takishima,et al.  An intuitive interface based on camera parameters for portable devices , 2006, SIGGRAPH '06.