The Prose Storyboard Language: A Tool for Annotating and Directing Movies

The prose storyboard language is a formal language for describing movies shot by shot, where each shot is described with a unique sentence. The language uses a simple syntax and limited vocabulary borrowed from working practices in traditional movie-making, and is intended to be readable both by machines and humans. The language is designed to serve as a high-level user interface for intelligent cinematography and editing systems.

[1]  Barry Salt,et al.  Film Style and Technology: History and Analysis , 1983 .

[2]  Andreas Meier,et al.  Timisto: a technique to extract usage sequences from storyboards , 2013, EICS '13.

[3]  Patrick Bouthemy,et al.  From video shot clustering to sequence segmentation , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[4]  John A. Robinson,et al.  Techniques for automated reverse storyboarding , 2005 .

[5]  Ivan Luiz Marques Ricarte,et al.  Animation modeling with petri nets , 1998, Comput. Graph..

[6]  Rémi Ronfard,et al.  A Computational Framework for Vertical Video Editing , 2015, WICED@Eurographics.

[7]  Matthew Flatt.  Creating Languages in Racket , 2011 .

[8]  Michael Ondaatje,et al.  The Conversations: Walter Murch and the Art of Editing Film , 2002 .

[9]  David Bordwell,et al.  On the history of film style , 1997 .

[10]  David Salesin,et al.  The virtual cinematographer: a paradigm for automatic real-time camera control and directing , 1996, SIGGRAPH.

[11]  Yishai A. Feldman,et al.  Automated cinematic reasoning about camera behavior , 2006, Expert Syst. Appl..

[12]  Patrick Olivier,et al.  Camera Control in Computer Graphics , 2006, Eurographics.

[13]  Mike Robey,et al.  Petri Net Script: a visual language for describing action, behaviour and plot , 2001, Proceedings 24th Australian Computer Science Conference. ACSC 2001.

[14]  Shen Jinhong,et al.  Intelligent digital filmmaker DMP , 2003, Proceedings Fifth International Conference on Computational Intelligence and Multimedia Applications. ICCIMA 2003.

[15]  Rik Van de Walle,et al.  Movie script markup language , 2009, DocEng '09.

[16]  Rémi Ronfard,et al.  A framework for aligning and indexing movies with their script , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[17]  Matthew Brand,et al.  The "Inverse Hollywood Problem": From Video to Scripts and Storyboards via Causal Analysis , 1997, AAAI/IAAI.

[18]  Timothy Baldwin,et al.  Towards Automatic Animated Storyboarding , 2008, AAAI.

[19]  Rémi Ronfard,et al.  Computational Model of Film Editing for Interactive Storytelling , 2011, ICIDS.

[20]  Robert Michael Young,et al.  A Discourse Planning Approach to Cinematic Camera Control for Narratives in Virtual Environments , 2005, AAAI.

[21]  Brian O'Neill,et al.  Towards intelligent authoring tools for machinima creation , 2009, CHI Extended Abstracts.

[22]  Angelos Yannopoulos,et al.  DirectorNotation: Artistic and technological system for professional film directing , 2013, JOCCH.

[23]  Rémi Ronfard.  A Review of Film Editing Techniques for Digital Games , 2012 .

[24]  Christopher J. Bowen.  Grammar of the Edit , 1993 .

[25]  David Salesin,et al.  Schematic storyboarding for video visualization and editing , 2006, SIGGRAPH '06.

[26]  Arif Ghafoor,et al.  Synchronization and Storage Models for Multimedia Objects , 1990, IEEE J. Sel. Areas Commun..

[27]  Rémi Ronfard,et al.  Film Editing for Third Person Games and Machinima , 2012 .

[28]  Rémi Ronfard,et al.  Steering Behaviors for Autonomous Cameras , 2013, MIG.

[29]  Rémi Ronfard.  Reading movies: an integrated DVD player for browsing movies and their scripts , 2004, MULTIMEDIA '04.

[30]  Norman I. Badler,et al.  Intelligent Camera Control Using Behavior Trees , 2011, MIG.

[31]  Roy Thompson,et al.  Grammar of the Shot , 1998 .

[32]  Robert Michael Young,et al.  Representational Requirements for a Plan Based Approach to Automated Camera Control , 2006, AIIDE.

[33]  Lijun Yin,et al.  Real-time automatic 3D scene generation from natural language voice and text descriptions , 2006, MM '06.

[34]  Nicolas Szilas,et al.  Narrative-driven camera control for cinematic replay of computer games , 2014, MIG.

[35]  Ismar Frango Silveira,et al.  SLAP: Storyboard Language for Animation Programming , 2016 .

[36]  David Salesin,et al.  Declarative Camera Control for Automatic Cinematography , 1996, AAAI/IAAI, Vol. 1.

[37]  Cyril Brom,et al.  Hierarchical Petri Nets for Story Plots Featuring Virtual Humans , 2008, AIIDE.

[38]  Hans Svensson,et al.  CarSim: An Automatic 3D Text-to-Scene Conversion System Applied to Road Accident Reports , 2003, EACL.

[39]  Rémi Ronfard,et al.  Detecting and Naming Actors in Movies Using Generative Appearance Models , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Rémi Ronfard,et al.  Camera-on-rails: automated computation of constrained camera paths , 2015, MIG.

[41]  Rémi Ronfard,et al.  Multi-clip video editing from a single viewpoint , 2014, CVMP.

[42]  J. Cutting.  Narrative theory and the dynamics of popular movies , 2016, Psychonomic bulletin & review.

[43]  Crystal Chao.  Timing multimodal turn-taking for human-robot cooperation , 2012, ICMI '12.