Android Application to Assist Visually Impaired with Outfit Coordination

ABSTRACT The paper presents an android based application to assist visually impaired with outfit coordination process. The application helps them to be independent in their decisions while shopping or getting ready for the day. The application matches apparel image input with user's previously saved closet items, then provides the user with the possible matching item suggestions. The matching process is done based on the item outline and dominating colours. In order to develop this application five main components have been developed: 1. Two through analogous and complementary matching, as opposed to Region of interest (ROI) extraction components facilitating feature and colour extraction; 2. An outline detection component to determine whether an item is a top, skirt or a pair of trousers; 3. A colour recognition component to extract dominant colours of an apparel image; 4. A descriptive colour verbal feedback; 5. A matching component based on item outline and colours to coordinate with others in the user‟s closet. The output to the user includes the descriptive colours, communicated via audio, indicating the 3 dominant colours using their descriptive names - selected from a pool of 581 different colour shades. Other output is the outline details of the matching items. The application was developed and tested on Android 2.2 (Froyo) and the results showed that the ROI extraction and outline detection components perform well. The colour recognition and descriptive name generation modules outperforms the current ones.

[1]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[2]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[3]  Shuai Yuan,et al.  Clothing Matching for Visually Impaired Persons. , 2011, Technology and disability.

[4]  Thomas K. Peucker,et al.  2. Algorithms for the Reduction of the Number of Points Required to Represent a Digitized Line or its Caricature , 2011 .

[5]  Lakshminarayanan Subramanian,et al.  Choosing which clothes to wear confidently: A tool for pattern matching , 2012 .

[6]  김만두,et al.  시력 손상과 시각 장애(Visual Impairment and Blindness) , 2011 .

[7]  Esther Hsu,et al.  Clothing Image Retrieval for Smarter Shopping , 2011 .

[8]  Jeffrey P. Bigham,et al.  Crowdsourcing subjective fashion advice using VizWiz: challenges and opportunities , 2012, ASSETS '12.

[9]  Joseph Rose.  Closet buddy: dressing the visually impaired , 2006, ACM-SE 44.

[10]  Keiichi Abe,et al.  Topological structural analysis of digitized binary images by border following , 1985, Comput. Vis. Graph. Image Process..

[11]  David H. Douglas,et al.  ALGORITHMS FOR THE REDUCTION OF THE NUMBER OF POINTS REQUIRED TO REPRESENT A DIGITIZED LINE OR ITS CARICATURE , 1973 .

[12]  Tomoharu Iwata,et al.  Fashion Coordinates Recommender System Using Photographs from Fashion Magazines , 2011, IJCAI.

[13]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[14]  Alain Trémeau,et al.  Color Quantization , 2008, Encyclopedia of Multimedia.