Multimedia Experience on Web-Connected CE Devices

Consumer electronics (CE) are changing from stand-alone single-function devices to products with increasing connectivity, convergence of functionality, and a focus on customer experience. We discuss the features that characterize the new generation of CE and illustrate this new paradigm through an examination of how web services can be integrated with CE products to deliver an improved user experience. In particular, we focus on one aspect of the CE segment, digital photography. We introduce AutoPhotobook, an automatic photobook creation service and provide a detailed look at how it addresses the complexity of photobook authoring through a portfolio of automatic photo analysis and composition technologies. We then show how this collection of technologies is integrated into a larger ecosystem with other web services and web-connected CE devices to deliver an enhanced user experience.

[1]  Jun Xiao,et al.  Mixed-initiative photo collage authoring , 2008, ACM Multimedia.

[2]  Andreas Paepcke,et al.  Time as essence for photo browsing through personal digital libraries , 2002, JCDL '02.

[3]  P. Roetling,et al.  Aesthetic measures for automated document layout , 2004, DocEng '04.

[4]  Dong Liu,et al.  Smart batch tagging of photo albums , 2009, MM '09.

[5]  Scott R. Klemmer,et al.  Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology , 2011, UIST 2011.

[6]  Carl Staelin,et al.  Automatic Photo Enhancement Server (HIPIE 2) , 2009 .

[7]  Hui Chao,et al.  Structured layout for resizable background art , 2009, IMCE '09.

[8]  João Batista S. de Oliveira,et al.  Two algorithms for automatic document page layout , 2008, ACM Symposium on Document Engineering.

[9]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, SIGGRAPH 2008.

[10]  Lisa S. Purvis,et al.  A genetic algorithm approach to automated custom document assembly , 2002 .

[11]  Dick C. A. Bulterman,et al.  DocEng '08 : proceedings of the Eighth ACM Symposium on Document Engineering : São Paulo, Brazil, September 16-19, 2008 , 2008 .

[12]  Harry Shum,et al.  Picture Collage , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[13]  Jiebo Luo,et al.  Mining GPS traces and visual words for event classification , 2008, MIR '08.

[14]  Susanne Boll,et al.  Processes of photo book production , 2008, Multimedia Systems.

[15]  Susanne Boll,et al.  Semantics, content, and structure of many for the creation of personal photo albums , 2007, ACM Multimedia.

[16]  Yasuyuki Matsushita,et al.  Efficient Optimization of Photo Collage , 2009 .

[17]  O. Sorkine,et al.  Optimized scale-and-stretch for image resizing , 2008, SIGGRAPH 2008.

[18]  Niels Henze,et al.  Snap and share your photobooks , 2008, ACM Multimedia.

[19]  Barry O'Sullivan,et al.  Creating personalized documents: an optimization approach , 2003, DocEng '03.

[20]  Nathan Moroney,et al.  Image collection taxonomies for photo-book auto-population with intuitive interaction , 2008, DocEng '08.

[21]  Roy Fielding,et al.  Architectural Styles and the Design of Network-based Software Architectures"; Doctoral dissertation , 2000 .

[22]  Clayton Brian Atkins.  Blocked recursive image composition , 2008, ACM Multimedia.

[23]  Hui Chao,et al.  Preserving the aesthetics during non-fixed aspect ratio scaling of the digital border , 2007, DocEng '07.

[24]  Phil Cheatle.  Automatic image cropping for republishing , 2010, Electronic Imaging.

[25]  Carman Neustaedter,et al.  Image annotation using personal calendars as context , 2008, ACM Multimedia.

[26]  Pierre Dragicevic,et al.  Artistic resizing: a technique for rich scale-sensitive vector graphics , 2006, SIGGRAPH '06.

[27]  Jun Xiao,et al.  Face based image navigation and search , 2009, MM '09.

[28]  Wilmot Li,et al.  Review of automatic document formatting , 2009, DocEng '09.

[29]  Eldan Goldenberg.  Automatic layout of variable-content print data , 2002 .

[30]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[31]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[32]  Ariel Shamir,et al.  Seam Carving for Content-Aware Image Resizing , 2007, ACM Trans. Graph..

[33]  Yuli Gao,et al.  Fast near duplicate detection for personal image collections , 2009, MM '09.

[34]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[35]  Bing-Yu Chen,et al.  Smart album: photo filtering by effect detections , 2008, SIGGRAPH '08.