Learning and Applying Color Styles From Feature Films

Directors employ a process called “color grading” to add color styles to feature films. Color grading is used for a number of reasons, such as accentuating a certain emotion or expressing the signature look of a director. We collect a database of feature film clips and label them with tags such as director, emotion, and genre. We then learn a model that maps from the low-level color and tone properties of film clips to the associated labels. This model allows us to examine a number of common hypotheses on the use of color to achieve goals, such as specific emotions. We also describe a method to apply our learned color styles to new images and videos. Along with our analysis of color grading techniques, we demonstrate a number of images and videos that are automatically filtered to resemble certain film styles.

[1]  Chun Chen,et al.  Data-driven image color theme enhancement , 2010, SIGGRAPH 2010.

[2]  Alan Hanjalic,et al.  Affective video content representation and modeling , 2005, IEEE Transactions on Multimedia.

[3]  Patti Bellantoni If It's Purple, Someone's Gonna Die: The Power of Color in Visual Storytelling , 2005 .

[4]  James E. Cutting,et al.  Low-Level Features of Film: What They Are and Why We Would Be Lost Without Them , 2013 .

[5]  Stan Matwin,et al.  Machine Learning for the Detection of Oil Spills in Satellite Radar Images , 1998, Machine Learning.

[6]  Barry Andersson The DSLR Filmmaker's Handbook: Real-World Production Techniques , 2012 .

[7]  Kurt Lancaster DSLR Cinema: Crafting the Film Look with Video , 2010 .

[8]  Gabriela Csurka,et al.  Building look & feel concept models from color combinations , 2011, The Visual Computer.

[9]  L. Ou,et al.  A study of colour emotion and colour preference. Part II: Colour emotions for two‐colour combinations , 2004 .

[10]  Loong Fah Cheong,et al.  Affective understanding in film , 2006, IEEE Trans. Circuits Syst. Video Technol..

[11]  Julie Dorsey,et al.  Understanding and improving the realism of image composites , 2012, ACM Trans. Graph..

[12]  Alexei A. Efros,et al.  Dating Historical Color Images , 2012, ECCV.

[13]  L. Ou,et al.  A study of colour emotion and colour preference. Part I: Colour emotions for single colours , 2004 .

[14]  Alexis Van Hurkman Color Correction Handbook: Professional Techniques for Video and Cinema , 2010 .

[15]  Naila Murray,et al.  Towards automatic concept transfer , 2011, NPAR '11.

[16]  Chuan-Kai Yang,et al.  Automatic Mood-Transferring between Color Images , 2008, IEEE Computer Graphics and Applications.

[17]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[18]  Shih-Fu Chang,et al.  Color-mood analysis of films based on syntactic and psychological models , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[19]  Julien Rabin,et al.  Regularization of transportation maps for color and contrast transfer , 2010, 2010 IEEE International Conference on Image Processing.

[20]  Yang Wang,et al.  Cost-sensitive boosting for classification of imbalanced data , 2007, Pattern Recognit..

[21]  Dani Lischinski,et al.  Non-rigid dense correspondence with applications for image enhancement , 2011, ACM Trans. Graph..

[22]  Alexei A. Efros,et al.  What makes Paris look like Paris? , 2015, Commun. ACM.

[23]  Mohan S. Kankanhalli,et al.  Modeling intent for home video repurposing , 2006, IEEE Multimedia.

[24]  Julie Dorsey,et al.  Crowd sourcing memory colors for image enhancement , 2012, SIGGRAPH '12.

[25]  Sn Yendrikhovskij,et al.  Color reproduction and the naturalness constraint , 1999 .

[26]  C. J. Bartleson Memory colors of familiar objects. , 1960, Journal of the Optical Society of America.

[27]  Yacov Hel-Or,et al.  Piecewise-consistent color mappings of images acquired under various conditions , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[28]  Sylvain Paris,et al.  Example-based video color grading , 2013, ACM Trans. Graph..

[29]  Yizhou Yu,et al.  Example-based image color and tone style enhancement , 2011, SIGGRAPH 2011.

[30]  Steve Hullfish The Art and Technique of Digital Color Correction , 2008 .

[31]  Yizhou Yu,et al.  Example-based image color and tone style enhancement , 2011, ACM Trans. Graph..

[32]  Erik Reinhard,et al.  Progressive histogram reshaping for creative color transfer and tone reproduction , 2010, NPAR.