Approaches to consumer image organization based on semantic categories

The primary goal of the current research was to develop image categorization algorithms that are more consistent with users' search strategies for their personal image collections. Other goals were to provide users with the option of correcting and labeling these image groups and to understand user behaviors and needs while they are using an automated image-organization system. The main focus of this paper is to provide automatic organization of images by two of the most important semantic classes in the consumer domain-events and people. Methods are described for automatically producing meaningful groups of images whereby each group depicts an event as well as clusters of similar faces in users' collections. Given that the proposed system envisions user interaction and is intended for organizing and searching personal collections, a usability study focused on consumers was conducted to gauge the performance of the system.

[1]  Andreas E. Savakis,et al.  Automated event clustering and quality screening of consumer pictures for digital albuming , 2003, IEEE Trans. Multim..

[2]  Anil K. Jain,et al.  Content-based hierarchical classification of vacation images , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[3]  Marcel Worring,et al.  Classification of user image descriptions , 2004, Int. J. Hum. Comput. Stud..

[4]  Peter G. B. Enser,et al.  Analysis of user need in image archives , 1997, J. Inf. Sci..

[5]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[6]  Benjamin B. Bederson,et al.  PhotoMesa: a zoomable image browser using quantum treemaps and bubblemaps , 2001, UIST '01.

[7]  Ben Shneiderman,et al.  Visualization methods for personal photo collections: browsing and searching in the PhotoFinder , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[8]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Kerry Rodden,et al.  Does organisation by similarity assist image browsing? , 2001, CHI.

[10]  Thomas S. Huang,et al.  Extending image retrieval with group-oriented interface , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[11]  Takeo Kanade,et al.  A statistical method for 3D object detection applied to faces and cars , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[12]  Shih-Fu Chang,et al.  Semantic visual templates: linking visual features to semantics , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[13]  R. K. Shyamasundar,et al.  Introduction to algorithms , 1996 .

[14]  Kerry Rodden,et al.  How do people manage their digital photographs? , 2003, CHI '03.

[15]  Alexander C. Loui,et al.  Automatic face-based image grouping for albuming , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[16]  Shoupu Chen,et al.  An Automatic Facial Feature Finding System for Portrait Images , 2002, PICS.