M-HinTS: mimicking humans in texture sorting

Various texture analysis algorithms have been developed the last decades. However, no computational model has arisen that mimics human texture perception adequately. In 2000, Payne, Hepplewhite, and Stoneham and in 2005, Van Rikxoort, Van den Broek, and Schouten achieved mappings between humans and artificial classifiers of respectively around 29% and 50%. In the current research, the work of Van Rikxoort et al. was replicated, using the newly developed, online card sorting experimentation platform M-HinTS: http://eidetic.ai.ru. nl/M-HinTS/. In two separate experiments, color and gray scale versions of 180 textures, drawn from the OuTex and VisTex texture databases were clustered by 34 subjects. The mutual agreement among these subjects was 51% and 52% for, respectively, the experiments with color and gray scale textures. The average agreement between the k-means algorithm and the participants was 36%, where k-means approximated some participants up to 60%. Since last year's results were not replicated, an additional data analysis was developed, which uses the semantic labels available in the database. This analysis shows that semantics play an important role in human texture clustering and once more illustrate the complexity of texture recognition. The current findings, the introduction of M-HinTS, and the set of analyzes discussed, are the start of a next phase in unraveling human texture recognition.

[1]  Erkki Oja,et al.  Reduced multidimensional histograms in color texture description , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[2]  Matti Pietikäinen,et al.  Outex - new framework for empirical evaluation of texture analysis algorithms , 2002, Object recognition supported by user interaction for service robots.

[3]  Julia Sturges,et al.  Locating basic colours in the munsell space , 1995 .

[4]  Egon L. van den Broek,et al.  Parallel-Sequential Texture Analysis , 2005, ICAPR.

[5]  A. Ravishankar Rao,et al.  Towards a texture naming system: Identifying relevant dimensions of texture , 1993, Vision Research.

[6]  R. M. Boynton,et al.  Locating basic colors in the OSA space , 1987 .

[7]  P. Kay,et al.  Basic Color Terms: Their Universality and Evolution , 1973 .

[8]  T. John Stonham,et al.  Applying perceptually based metrics to textural image retrieval methods , 2000, Electronic Imaging.

[9]  Jakob Nielsen,et al.  SunWeb: User Interface Design for Sun Microsystem's Internal Web , 1995, Comput. Networks ISDN Syst..

[10]  Wei Ji Ma,et al.  A detection theory account of visual short-term memory for color , 2004 .

[11]  Arnold W. M. Smeulders,et al.  Color-based object recognition , 1997, Pattern Recognit..

[12]  E. Drewe,et al.  The effect of type and area of brain lesion on Wisconsin card sorting test performance. , 1974, Cortex; a journal devoted to the study of the nervous system and behavior.

[13]  S. Singh,et al.  Evaluation of texture methods for image analysis , 2001, The Seventh Australian and New Zealand Intelligent Information Systems Conference, 2001.

[14]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[15]  Egon L. van den Broek,et al.  Human-Centered Object-Based Image Retrieval , 2005, ICAPR.

[16]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Egon L. van den Broek,et al.  Mimicking human texture classification , 2005, IS&T/SPIE Electronic Imaging.

[18]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[19]  Sameer Singh,et al.  Texture Analysis Experiments with Meastex and Vistex Benchmarks , 2001, ICAPR.