Open project: a lightweight framework for remote sharing of mobile applications

The form factor of mobile devices remains small while their computing power grows at an accelerated rate. Prior work has explored expanding the output space by leveraging free displays in the environment. However, existing solutions often do not scale. In this paper we discuss Open Project, an end-to-end framework that allows a user to "project" a native mobile application onto a display using a phone camera, leveraging interaction spaces ranging from a PC monitor to a public wall-sized display. Any display becomes projectable instantaneously by simply accessing the lightweight Open Project server via a web browser. By distributing computation load onto each projecting mobile device, our framework easily scales for hosting many projection sessions and devices simultaneously. Our performance experiments and user studies indicated that Open Project supported a variety of useful collaborative, sharing scenarios and performed reliably in diverse settings.

[1]  Daniel Jackson,et al.  Mobile Device and Intelligent Display Interaction via Scale-invariant Image Feature Matching , 2011, PECCS.

[2]  Meredith Ringel Morris,et al.  Code space: touch + air gesture hybrid interactions for supporting developer meetings , 2011, ITS '11.

[3]  Steven K. Feiner,et al.  Virtual projection: exploring optical projection as a metaphor for multi-device interaction , 2012, CHI.

[4]  Xiang Cao,et al.  Interactive Environment-Aware Handheld Projectors for Pervasive Computing Spaces , 2012, Pervasive.

[5]  Fabio Remondino,et al.  TARGETLESS CAMERA CALIBRATION , 2012 .

[6]  Kathy Ryall,et al.  UbiTable: Impromptu Face-to-Face Collaboration on Horizontal Interactive Surfaces , 2003, UbiComp.

[7]  Shumin Zhai,et al.  Camera phone based motion sensing: interaction techniques, applications and performance study , 2006, UIST.

[8]  Yang Li,et al.  Deep shot: a framework for migrating tasks across devices using mobile phone cameras , 2011, CHI.

[9]  Yvonne Rogers,et al.  Dynamo: a public interactive surface supporting the cooperative sharing and exchange of media , 2003, UIST '03.

[10]  Monica M. C. Schraefel,et al.  The radial scroll tool: scrolling support for stylus- or touch-based document navigation , 2004, UIST '04.

[11]  Jun Rekimoto,et al.  Augmented surfaces: a spatially continuous work space for hybrid computing environments , 1999, CHI '99.

[12]  Desney S. Tan,et al.  WinCuts: manipulating arbitrary window regions for more effective use of screen space , 2004, CHI EA '04.

[13]  Michael Rohs,et al.  Real-World Interaction with Camera Phones , 2004, UCS.

[14]  Hrvoje Benko,et al.  Combining multiple depth cameras and projectors for interactions on, above and between surfaces , 2010, UIST.

[15]  Xiang Cao,et al.  Multi-user interaction using handheld projectors , 2007, UIST.

[16]  Marko Jurmu,et al.  Scroll, tilt or move it: using mobile phones to continuously control pointers on large public displays , 2009, OZCHI.

[17]  Michael Rohs,et al.  Sweep and point and shoot: phonecam-based interactions for large public displays , 2005, CHI Extended Abstracts.

[18]  Xiang Cao,et al.  Interacting with dynamically defined information spaces using a handheld projector and a pen , 2006, UIST.

[19]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[20]  Paul A. Beardsley,et al.  Interaction using a handheld projector , 2005, IEEE Computer Graphics and Applications.

[21]  C. Fraser,et al.  Digital camera calibration methods: Considerations and comparisons , 2006 .

[22]  Steven K. Feiner,et al.  Exploring interaction with a simulated wrist-worn projection display , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[23]  Saul Greenberg,et al.  The notification collage: posting information to public and personal displays , 2001, CHI.

[24]  Hao Jiang,et al.  WeSpace: the design development and deployment of a walk-up and share multi-surface visual collaboration system , 2009, CHI.

[25]  Dan R. Olsen,et al.  XICE windowing toolkit: Seamless display annexation , 2011, TCHI.