Explorative visualization and analysis of a social network for arts: the case of deviantART

deviantART is one of the leading social online network sites with a focus on user-generated artworks. The website has a rich data archive of around 150 million images uploaded by its 15 million members, making it the largest art platform today. This paper describes an open source toolkit that provides a humanities scholar with necessary computational tools to analyse and visualise deviantART and similar art collections. To this end, we combine tools from different research fields such as network analysis, computer vision, machine learning and data visualisation. The toolkit provides the functionality to extract data about members and their artworks directly from the deviantART website, using network analysis to select key members for further investigation. The chosen members' images are automatically downloaded and annotated with different image features, along with which they can be visualised. The visualisation options offered in the implemented toolkit links images to their originals and can be used to explore and analyse the dataset in an interactive way. The toolkit also features an SVM-based classifier to automatically select features to discriminate artists, artworks and styles, which is hidden from the user behind a simple "suggest features" option.

[1]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Christof Koch,et al.  Modeling attention to salient proto-objects , 2006, Neural Networks.

[3]  Christos Faloutsos,et al.  Fast Nearest Neighbor Search in Medical Image Databases , 1996, VLDB.

[4]  Alkim Almila Akdag Salah.  The online potential of art creation and dissemination: DeviantArt as the next art venue , 2010, EVA.

[5]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[6]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[7]  Ingo Schmitt,et al.  An Approach to Visualize Image Retrieval Results , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[8]  L. Ou,et al.  A study of colour emotion and colour preference. Part I: Colour emotions for single colours , 2004 .

[9]  Marcel P. Lucassen,et al.  Adding texture to color: quantitative analysis of color emotions , 2010, CGIV/MCS.

[10]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Chaomei Chen,et al.  Content-based image visualization , 2000, 2000 IEEE Conference on Information Visualization. An International Conference on Computer Visualization and Graphics.

[12]  Alex Zelinsky,et al.  Learning OpenCV---Computer Vision with the OpenCV Library (Bradski, G.R. et al.; 2008)[On the Shelf] , 2009, IEEE Robotics & Automation Magazine.

[13]  Peter L. Brooks,et al.  Visualizing data , 1997 .

[14]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[15]  Cor J. Veenman,et al.  Robust Scene Categorization by Learning Image Statistics in Context , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[16]  Akihiro Sugimoto,et al.  An Interface for Visualizing Feature Space in Image Retrieval , 1998, MVA.

[17]  Vapnik,et al.  SVMs for Histogram Based Image Classification , 1999 .

[18]  Oscar Firschein,et al.  Readings in computer vision: issues, problems, principles, and paradigms , 1987 .

[19]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[20]  Jeremy Douglass,et al.  Understanding scanlation: how to read one million fan-translated manga pages , 2011 .

[21]  Jianping Fan,et al.  Semantic Image Browser: Bridging Information Visualization with Automated Intelligent Image Analysis , 2006, 2006 IEEE Symposium On Visual Analytics Science And Technology.

[22]  Gennady Andrienko,et al.  Constructing Parallel Coordinates Plot for Problem Solving , 2001 .

[23]  Marcel Worring,et al.  Optimization of interactive visual-similarity-based search , 2008, TOMCCAP.

[24]  Robert P. W. Duin,et al.  PRTools - Version 3.0 - A Matlab Toolbox for Pattern Recognition , 2000 .

[25]  Witold Malina,et al.  On an Extended Fisher Criterion for Feature Selection , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Daniel Keren,et al.  Recognizing image "style" and activities in video using local features and naive Bayes , 2003, Pattern Recognit. Lett..

[27]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .