An Exploration of User Interface Designs for Real-Time Panoramic

Image stitching allows users to combine multiple regular-sized photographs into a single wide-angle picture, often referred to as a panoramic picture. To create such a panoramic picture, users traditionally first take all the photographs, then upload them to a PC and stitch. During stitching, however, users often discover that the produced panorama contains artifacts or is incomplete. Fixing these flaws requires retaking individual images, which is often difficult by this time. In this paper, we present Panoramic Viewfinder, an interactive system for panorama construction that offers a real-time preview of the panorama while shooting. As the user swipes the camera across the scene, each photo is immediately added to the preview. By making ghosting and stitching failures apparent, the system allows users to immediately retake necessary images. The system also provides a preview of the cropped panorama. When this preview includes all desired scene elements, users know that the panorama will be complete. Unlike earlier work in the field of real-time stitching, this paper focuses on the user interface aspects of real-time stitching. We describe our prototype, individual shooting modes, and provide an overview of our implementation. Building on our experiences with Panoramic Viewfinder, we discuss a separate design that relaxes the level of synchrony between user and camera required by the current system and provide usage flexibility that we believe might further improve the user experience.

[1]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[2]  Harpreet S. Sawhney,et al.  VideoBrush/sup TM/: experiences with consumer video mosaicing , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[3]  Patrick Baudisch,et al.  Keeping things in context: a comparative evaluation of focus plus context screens, overviews, and zooming , 2002, CHI.

[4]  Desney S. Tan,et al.  Panoramic viewfinder: providing a real-time preview to help users avoid flaws in panoramic pictures , 2005, OZCHI.

[5]  Ka-Ping Yee,et al.  Peephole displays: pen interaction on spatially aware handheld computers , 2003, CHI '03.

[6]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[7]  Michal Irani,et al.  Video indexing based on mosaic representations , 1998, Proc. IEEE.

[8]  Richard Szeliski,et al.  Efficiently registering video into panoramic mosaics , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[9]  P. Anandan,et al.  Hierarchical Model-Based Motion Estimation , 1992, ECCV.

[10]  Walter Bender,et al.  Salient video stills: content and context preserved , 1993, MULTIMEDIA '93.

[11]  Richard Szeliski,et al.  Video mosaics for virtual environments , 1996, IEEE Computer Graphics and Applications.

[12]  Betty Edwards,et al.  The new drawing on the right side of the brain workbook : guided practice in the five basic skills of drawing , 1979 .

[13]  Richard Szeliski,et al.  Multi-image matching using multi-scale oriented patches , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Frada Burstein,et al.  Australian Journal of Information Systems , 2001 .

[15]  Shmuel Peleg,et al.  Panoramic mosaics by manifold projection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  David Hsu,et al.  Computing the largest inscribed isothetic rectangle , 1995, CCCG.

[17]  Harpreet S. Sawhney,et al.  Robust Video Mosaicing through Topology Inference and Local to Global Alignment , 1998, ECCV.

[18]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[19]  Patrick Baudisch,et al.  Don't click, paint! Using toggle maps to manipulate sets of toggle switches , 1998, UIST '98.

[20]  George W. Fitzmaurice,et al.  Situated information spaces and spatially aware palmtop computers , 1993, CACM.

[21]  Jun Rekimoto,et al.  Tilting operations for small screen interfaces , 1996, UIST '96.

[22]  Steve Mann,et al.  Virtual bellows: constructing high quality stills from video , 1994, Proceedings of 1st International Conference on Image Processing.