Interactive important social character identification from large photo collections

In the paper, we describe a mechanism to identify important social characters by analyzing the social structures embedded in photo collections. We first construct a weighted undirected graph from photo collections by examining the co-appearance of individuals in photos, wherein the weights of edges are measures of the social closeness of the involved individuals (vertices in the graph). Then a graph clustering algorithm that maximizes the modularity of the graph partition is applied to detect the embedded social clusters. Once the social clusters are identified, we measure individual's contribution to the formation of a social cluster to quantify the social importance of each character in the cluster. To compensate the discrepancy between the user-perceived important social characters and the algorithmically computed ones, we propose an interactive browsing scheme to enable viewers quickly identify import social characters that conform to their subjectivity. The effectiveness of the proposed mechanism is demonstrated through experiments on consumer photo collections.

[1]  M. Newman,et al.  Finding community structure in networks using the eigenvectors of matrices. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  Xiaoqing Ding,et al.  Clustering Consumer Photos Based on Face Recognition , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[3]  Scott A. Golder Measuring social networks with digital photograph collections , 2008, Hypertext.

[4]  Peng Wu,et al.  Close & Closer: Discover social relationship from photo collections , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[5]  Shlomo Hershkop,et al.  Automated social hierarchy detection through email network analysis , 2007, WebKDD/SNA-KDD '07.

[6]  Trevor Darrell,et al.  Autotagging Facebook: Social network context improves photo annotation , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.