Digital panning shot generator from photographs

Panning in photography is known as the rotation of the camera horizontally. It refers to a technique whereby one follows a moving subject and takes a photo with a slow shutter speed. This creates a blurred background, while retaining sharpness in the subject. Panning shot is widely used in sports activities because it dramatically emphasizes the movement of the subject. However, it is not easy for amateur photographers to take plausible panning shots. This paper represents a digital algorithm to automatically generate panning shots using two photographs taken consecutively in time. The presented algorithm makes even novice photographers take professional panning shots very easily.

[1]  Wojciech Matusik,et al.  Progressively-Refined Reflectance Functions from Natural Illumination , 2004 .

[2]  Jung-Hyun Lee,et al.  Real-Time Head Tracking using Adaptive Boosting in Surveillance , 2013 .

[3]  Konstantin Mischaikow,et al.  Feature-based surface parameterization and texture mapping , 2005, TOGS.

[4]  Michael F. Cohen,et al.  Capturing and viewing gigapixel images , 2007, ACM Trans. Graph..

[5]  Neil A. Dodgson,et al.  Decolorize: Fast, contrast enhancing, color to grayscale conversion , 2007, Pattern Recognit..

[6]  Michael Cohen,et al.  Soft scissors: an interactive tool for realtime high quality matting , 2007, SIGGRAPH 2007.

[7]  Jing Zhang,et al.  A smartphone based real-time daily activity monitoring system , 2014, Cluster Computing.

[8]  Karol Myszkowski,et al.  Apparent Greyscale: A Simple and Fast Conversion to Perceptually Accurate Images and Video , 2008, Comput. Graph. Forum.

[9]  Xing Xie,et al.  A visual attention model for adapting images on small displays , 2003, Multimedia Systems.

[10]  Young-Sik Jeong,et al.  Mobile image sensors for object detection using color segmentation , 2013, Cluster Computing.

[11]  Yong-Hwan Lee,et al.  Image Retrieval using Multiple Features on Mobile Platform , 2014 .

[12]  Seungyong Lee,et al.  Robust color-to-gray via nonlinear global mapping , 2009, ACM Trans. Graph..

[13]  Tong-Yee Lee,et al.  Motion-based video retargeting with optimized crop-and-warp , 2010, SIGGRAPH 2010.

[14]  Benjamin B. Bederson,et al.  Automatic thumbnail cropping and its effectiveness , 2003, UIST '03.

[15]  Ramesh Raskar,et al.  Non-photorealistic camera: depth edge detection and stylized rendering using multi-flash imaging , 2004, SIGGRAPH 2004.

[16]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[17]  Ashish Kapoor,et al.  Learning a blind measure of perceptual image quality , 2011, CVPR 2011.

[18]  Brian L. Evans,et al.  Unsupervised automation of photographic composition rules in digital still cameras , 2004, IS&T/SPIE Electronic Imaging.

[19]  Michael F. Cohen,et al.  An iterative optimization approach for unified image segmentation and matting , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[20]  F. Durand,et al.  Texture design using a simplicial complex of morphable textures , 2005, SIGGRAPH 2005.

[21]  Seungyong Lee,et al.  Digital shallow depth-of-field adapter for photographs , 2007, The Visual Computer.

[22]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[23]  David Salesin,et al.  Gaze-based interaction for semi-automatic photo cropping , 2006, CHI.

[24]  Guillermo Sapiro,et al.  Interactive Image Segmentation via Adaptive Weighted Distances , 2007, IEEE Transactions on Image Processing.

[25]  Jitendra Malik,et al.  Robust computation of optical flow in a multi-scale differential framework , 2005, International Journal of Computer Vision.

[26]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[27]  Myung-Ryul Choi,et al.  A Road Region Extraction Using OpenCV CUDA To Advance The Processing Speed , 2014 .

[28]  Yuanjie Zheng,et al.  FuzzyMatte: A computationally efficient scheme for interactive matting , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Brian L. Evans,et al.  In-Camera Automation of Photographic Composition Rules , 2007, IEEE Transactions on Image Processing.

[30]  Pieter Peers,et al.  Relighting with 4D incident light fields , 2003, ACM Trans. Graph..

[31]  Dani Lischinski,et al.  Joint bilateral upsampling , 2007, SIGGRAPH 2007.

[32]  Bruce Gooch,et al.  Color2Gray: salience-preserving color removal , 2005, SIGGRAPH 2005.

[33]  Yasuyuki Matsushita,et al.  Removing Non-Uniform Motion Blur from Images , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[34]  David J. Fleet,et al.  Computing Optical Flow with Physical Models of Brightness Variation , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Kun-Ho Yoon,et al.  M2M-based smart health service for human UI/UX using motion recognition , 2014, Cluster Computing.

[36]  정규만,et al.  Paradigm Shift of Camera: Part I. Computational Photography , 2009 .

[37]  David A. Forsyth,et al.  Generalizing motion edits with Gaussian processes , 2009, ACM Trans. Graph..

[38]  Hui Ma,et al.  Image Deblurring with Blurred / Noisy Image Pairs , 2013 .

[39]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, SIGGRAPH 2008.

[40]  S. Nayar,et al.  Diffusion coded photography for extended depth of field , 2010, SIGGRAPH 2010.

[41]  Ramesh Raskar,et al.  Switchable primaries using shiftable layers of color filter arrays , 2011, SIGGRAPH 2011.

[42]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, SIGGRAPH 2007.

[43]  Michael F. Cohen,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[44]  Brian L. Evans,et al.  Unsupervised merger detection and mitigation in still images using frequency and color content analysis , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[45]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH.

[46]  Raanan Fattal,et al.  Image and video upscaling from local self-examples , 2011, TOGS.

[47]  Marc Levoy,et al.  Veiling glare in high dynamic range imaging , 2007, SIGGRAPH 2007.

[48]  Jung-Hyun Lee,et al.  Object Detection and Tracking using Bayesian Classifier in Surveillance , 2012 .

[49]  Frédo Durand,et al.  Defocus video matting , 2005, ACM Trans. Graph..

[50]  Nikolaos Laoutaris,et al.  Study of the Impact of Replacement Granularity and Associated Strategies on Video Caching , 2004, Cluster Computing.

[51]  Frédo Durand,et al.  Flash photography enhancement via intrinsic relighting , 2004, SIGGRAPH 2004.

[52]  Frédo Durand,et al.  Defocus video matting , 2005, SIGGRAPH 2005.

[53]  Dong-Woo Lee A Study on Medical Information System in Health/Medical Industry Convergence , 2014 .

[54]  Guillermo Sapiro,et al.  A Geodesic Framework for Fast Interactive Image and Video Segmentation and Matting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[55]  Chi-Keung Tang,et al.  Fast image/video upsampling , 2008, SIGGRAPH 2008.

[56]  Steven S. Beauchemin,et al.  The computation of optical flow , 1995, CSUR.

[57]  Tomoyuki Nishita,et al.  Extracting depth and matte using a color-filtered aperture , 2008, SIGGRAPH Asia '08.

[58]  Jack Tumblin Concepts in computational photography , 2006, SIGGRAPH Courses.

[59]  William T. Freeman,et al.  Removing camera shake from a single photograph , 2006, SIGGRAPH 2006.

[60]  Tong-Yee Lee,et al.  Scalable and coherent video resizing with per-frame optimization , 2011, SIGGRAPH 2011.

[61]  Guillermo Sapiro,et al.  Fast image and video colorization using chrominance blending , 2006, IEEE Transactions on Image Processing.

[62]  Guillermo Sapiro,et al.  Geodesic Matting: A Framework for Fast Interactive Image and Video Segmentation and Matting , 2009, International Journal of Computer Vision.