Mobile Devices

This paper presents analysis/synthesis strategies for generating abstract, creative representations via the camera input on a mobile device. Mobile devices are well suited for interactive video processing since they are simultaneously capable of image capture, display, and manipulation. Analysis/synthesis methods are particularly powerful in interactive arts projects as they enable even drastic manipulations of the input image while still maintaining fundamental aspects of its original identity. Moreover, by using abstract synthesis elements (i.e., coherent elements larger than single pixels), we are able to directly interact with the image and to manipulate its final output. We describe some of the exciting capabilities of video processing and interaction on mobile devices and introduce a series of mobile applications that use analysis/synthesis techniques.

[1]  Frank Dietrich.  Visual Intelligence: The First Decade of Computer Art (1965-1975) , 1985, IEEE Computer Graphics and Applications.

[2]  Joëlle Thollot,et al.  A Dynamic Noise Primitive for Coherent Stylization , 2010, Comput. Graph. Forum.

[3]  Adrien Bousseau,et al.  State‐of‐the‐Art Report on Temporal Coherence for Stylized Animations , 2011, Comput. Graph. Forum.

[4]  Adrien Bousseau,et al.  Dynamic solid textures for real-time coherent stylization , 2009, I3D '09.

[5]  James B. Bean,et al.  Aluminum , 1867, The American journal of dental science.

[6]  Angus G. Forbes,et al.  Iterative Synaesthetic Composing with Multimedia signals , 2012, ICMC.

[7]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[8]  S. Poggenpohl.  Windows and Mirrors: Interaction Design, Digital Art and the Myth of Transparency , 2007 .

[9]  Charles Csuri,et al.  Art, Computers and Mathematics , 1899 .

[10]  T. Flash,et al.  Minimum-jerk, two-thirds power law, and isochrony: converging approaches to movement planning. , 1995, Journal of experimental psychology. Human perception and performance.

[11]  Jasia Reichardt,et al.  Cybernetic serendipity : the computer and the arts , 1969 .

[12]  Peter Litwinowicz,et al.  Processing images and video for an impressionist effect , 1997, SIGGRAPH.

[13]  Amit Agrawal.  Non-photorealistic Rendering: Unleashing the Artist's Imagination [Graphically Speaking] , 2009, IEEE Computer Graphics and Applications.

[14]  Master Gardener,et al.  Mathematical games: the fantastic combinations of john conway's new solitaire game "life , 1970 .

[15]  Paul Haeberli,et al.  Paint by numbers: abstract image representations , 1990, SIGGRAPH.

[16]  Tobias Höllerer,et al.  Generative fluid profiles for interactive media arts projects , 2013, CAE '13.