Comparing Personal Image Collections with PICTuReVis

Digital image collections contain a wealth of information, which for instance can be used to trace illegal activities and investigate criminal networks. We present a method that enables analysts to reveal relations among people, based on the patterns in their collections. Similar temporal and spatial patterns can be found using a parameterized algorithm, visualization is used to choose the right parameters and to inspect the patterns found. The visualization shows relations between image properties: the person it belongs to, the concepts in the image, its time stamp and location. We demonstrate the method with image collections of 10, 000 people containing 460, 000 images in total.

[1]  Michael G. Kahn,et al.  The visual display of temporal information , 1991, Artif. Intell. Medicine.

[2]  Yangqiu Song,et al.  ImageHive: Interactive Content-Aware Image Summarization , 2012, IEEE Computer Graphics and Applications.

[3]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[4]  Ben Shneiderman,et al.  LifeLines: visualizing personal histories , 1996, CHI.

[5]  David Williams,et al.  The attribute explorer , 1994, CHI '94.

[6]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[7]  Marcel Worring,et al.  Interactive Multimodal Learning for Venue Recommendation , 2015, IEEE Transactions on Multimedia.

[8]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[9]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[10]  Jarke J. van Wijk,et al.  Exploring Items and Features with IF, FI-Tables , 2016, Comput. Graph. Forum.

[11]  Ben Shneiderman,et al.  Finding comparable temporal categorical records: A similarity measure with an interactive visualization , 2009, 2009 IEEE Symposium on Visual Analytics Science and Technology.

[12]  M. Sheelagh T. Carpendale,et al.  A Visual Backchannel for Large-Scale Events , 2010, IEEE Transactions on Visualization and Computer Graphics.

[13]  Eamonn J. Keogh,et al.  On the Need for Time Series Data Mining Benchmarks: A Survey and Empirical Demonstration , 2002, Data Mining and Knowledge Discovery.

[14]  Dennis Koelma,et al.  The ImageNet Shuffle: Reorganized Pre-training for Video Event Detection , 2016, ICMR.

[15]  Danilo Medeiros Eler,et al.  Visual analysis of image collections , 2009, The Visual Computer.

[16]  Jianping Fan,et al.  Semantic Image Browser: Bridging Information Visualization with Automated Intelligent Image Analysis , 2006, 2006 IEEE Symposium On Visual Analytics Science And Technology.

[17]  Heidrun Schumann,et al.  Visualization of Time-Oriented Data , 2011, Human-Computer Interaction Series.

[18]  Jun Ma,et al.  Similarity-based visualization of large image collections , 2015, Inf. Vis..

[19]  Marcel Worring,et al.  Multimedia Pivot Tables for Multimedia Analytics on Image Collections , 2016, IEEE Transactions on Multimedia.

[20]  Gerald Schaefer,et al.  Image retrieval on the Honeycomb Image Browser , 2010, 2010 IEEE International Conference on Image Processing.

[21]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Ben Shneiderman,et al.  EventAction: Visual analytics for temporal event sequence recommendation , 2016, 2016 IEEE Conference on Visual Analytics Science and Technology (VAST).

[23]  E. J. van Eijk,et al.  Digital forensics as a service: Game on , 2015, Digit. Investig..

[24]  Jarke J. van Wijk,et al.  ICLIC: Interactive categorization of large image collections , 2016, 2016 IEEE Pacific Visualization Symposium (PacificVis).

[25]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[26]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[27]  Marcel Worring,et al.  MediaTable: Interactive Categorization of Multimedia Collections , 2010, IEEE Computer Graphics and Applications.

[28]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[29]  Denis Gracanin,et al.  Large Image Collections - Comprehension and Familiarization by Interactive Visual Analysis , 2009, Smart Graphics.