PanoSwarm: Collaborative and Synchronized Multi-Device Panoramic Photography

Taking a picture has been traditionally a one-person task. In this paper we present a novel system that allows multiple mobile devices to work collaboratively in a synchronized fashion to capture a panorama of a highly dynamic scene, creating an entirely new photography experience that encourages social interactions and teamwork. Our system contains two components: a client app that runs on all participating devices, and a server program that monitors and communicates with each device. In a capturing session, the server collects in realtime the viewfinder images of all devices and stitches them on-the-fly to create a panorama preview, which is then streamed to all devices as visual guidance. The system also allows one camera to be the host and send direct visual instructions to others to guide camera adjustment. When ready, all devices take pictures at the same time for panorama stitching. Our preliminary study suggests that the proposed system can help users capture high quality panoramas with an enjoyable teamwork experience.

[1]  David Salesin,et al.  Interactive digital photomontage , 2004, ACM Trans. Graph..

[2]  Zoran Popovic,et al.  PhotoCity: training experts at large-scale image acquisition through a competitive game , 2011, CHI.

[3]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[4]  Yingen Xiong,et al.  Fast panorama stitching for high-quality panoramic images on mobile phones , 2010, IEEE Transactions on Consumer Electronics.

[5]  Michael F. Cohen,et al.  Looking at you: fused gyro and face tracking for viewing large imagery on mobile devices , 2012, CHI.

[6]  Vijay Kumar,et al.  Multi-robot coverage and exploration on Riemannian manifolds with boundaries , 2014, Int. J. Robotics Res..

[7]  Jan Kautz,et al.  Video collections in panoramic contexts , 2013, UIST.

[8]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, ACM Trans. Graph..

[9]  Robert E. Kraut,et al.  Controlling interruptions: awareness displays and social motivation for coordination , 2004, CSCW.

[10]  Antti Oulasvirta,et al.  It's Mine, Don't Touch!: interactions at a large multi-touch display in a city centre , 2008, CHI.

[11]  Marc Levoy,et al.  High-speed videography using a dense camera array , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[12]  Richard Szeliski,et al.  Panoramic Viewfinder : Shooting Panoramic Pictures With the Help of a Real-Time Preview , 2005 .

[13]  Aniket Kittur,et al.  Coordination in collective intelligence: the role of team structure and task interdependence , 2009, CHI.

[14]  Andreas Butz,et al.  Multi-user interaction on media facades through live video on mobile devices , 2011, CHI.

[15]  James Davis,et al.  Mosaics of scenes with moving objects , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[16]  Vijay Kumar,et al.  Planning for opportunistic surveillance with multiple robots , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.