Modeling Fashion Influence From Photos

The evolution of clothing styles and their migration across the world is intriguing, yet difficult to describe quantitatively. We propose to discover and quantify fashion influences from catalog and social media photos. We explore fashion influence along two channels: geolocation and fashion brands. We introduce an approach that detects which of these entities influence which other entities in terms of propagating their styles. We then leverage the discovered influence patterns to inform a novel forecasting model that predicts the future popularity of any given style within any given city or brand. To demonstrate our idea, we leverage public large-scale datasets of 7.7M Instagram photos from 44 major world cities (where styles are worn with variable frequency) as well as 41K Amazon product photos (where styles are purchased with variable frequency). Our model learns directly from the image data how styles move between locations and how certain brands affect each other's designs in a predictable way. The discovered influence relationships reveal how both cities and brands exert and receive fashion influence for an array of visual styles inferred from the images. Furthermore, the proposed forecasting model achieves state-of-the-art results for challenging style forecasting tasks. Our results indicate the advantage of grounding visual style evolution both spatially and temporally, and for the first time, they quantify the propagation of inter-brand and inter-city influences.

[1]  E. Yesil,et al.  Fuzzy Forecast Combining for Apparel Demand Forecasting , 2014 .

[2]  Kristen Grauman,et al.  From Paris to Berlin: Discovering Fashion Style Influences Around the World , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Guanbin Li,et al.  Fashion Retrieval via Graph Reasoning Networks on a Similarity Pyramid , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[4]  Qiang Chen,et al.  Cross-Domain Image Retrieval with a Dual Attribute-Aware Ranking Network , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[5]  Changsheng Xu,et al.  Hi, magic closet, tell me what to wear! , 2012, ACM Multimedia.

[6]  Mengting Wan,et al.  Decomposing fit semantics for product size recommendation in metric spaces , 2018, RecSys.

[7]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Larry S. Davis,et al.  FiNet: Compatible and Diverse Fashion Image Inpainting , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[9]  Dafna Shahaf,et al.  Connecting the dots between news articles , 2010, IJCAI.

[10]  Hanjiang Lai,et al.  Towards Multi-Pose Guided Virtual Try-On Network , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[11]  Jiebo Luo,et al.  Who are the Devils Wearing Prada in New York City? , 2015, ACM Multimedia.

[12]  David J. Kriegman,et al.  Urban tribes: Analyzing group photos from a social perspective , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[13]  Robinson Piramuthu,et al.  Brand > Logo: Visual Analysis of Fashion Brands , 2018, ECCV Workshops.

[14]  Yang Hu,et al.  Personalized Fashion Design , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[15]  Liang Lin,et al.  Toward Characteristic-Preserving Image-based Virtual Try-On Network , 2018, ECCV.

[16]  Alexander C. Berg,et al.  Hipster Wars: Discovering Elements of Fashion Styles , 2014, ECCV.

[17]  Na Liu,et al.  Fashion Sales Forecasting With a Panel Data-Based Particle-Filter Model , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[18]  Alexander C. Berg,et al.  Automatic Attribute Discovery and Characterization from Noisy Web Data , 2010, ECCV.

[19]  Meng Wang,et al.  Predicting occupation via human clothing and contexts , 2011, 2011 International Conference on Computer Vision.

[20]  Yu Liu,et al.  SwapGAN: A Multistage Generative Approach for Person-to-Person Fashion Style Transfer , 2019, IEEE Transactions on Multimedia.

[21]  Huizhong Chen,et al.  Describing Clothing by Semantic Attributes , 2012, ECCV.

[22]  Noah Snavely,et al.  StreetStyle: Exploring world-wide clothing styles from millions of photos , 2017, ArXiv.

[23]  C. Granger Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[24]  Svetlana Lazebnik,et al.  Where to Buy It: Matching Street Clothing Photos in Online Shops , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[25]  Luc Van Gool,et al.  Apparel Classification with Style , 2012, ACCV.

[26]  Wen-Huang Cheng,et al.  What are the Fashion Trends in New York? , 2014, ACM Multimedia.

[27]  Isay Katsman,et al.  Fashion++: Minimal Edits for Outfit Improvement , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[28]  Rainer Stiefelhagen,et al.  Fashion Forward: Forecasting Visual Style in Fashion , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[29]  Hau-Ling Chan,et al.  A Comparative Study on Fashion Demand Forecasting Models with Multiple Sources of Uncertainty , 2017, Ann. Oper. Res..

[30]  Noah Snavely,et al.  GeoStyle: Discovering Fashion Trends and Events , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[31]  Logica Banica,et al.  Neural Networks Based Forecasting for Romanian Clothing Sector , 2014 .

[32]  Yongdong Zhang,et al.  Trip Outfits Advisor: Location-Oriented Clothing Recommendation , 2017, IEEE Transactions on Multimedia.

[33]  Changsheng Xu,et al.  Street-to-shop: Cross-scenario clothing retrieval via parts alignment and auxiliary set , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Xu Sun,et al.  Modeling Scientific Influence for Research Trending Topic Prediction , 2018, AAAI.

[35]  Song-Chun Zhu,et al.  Attentive Fashion Grammar Network for Fashion Landmark Detection and Clothing Category Classification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[36]  Xiaogang Wang,et al.  DeepFashion: Powering Robust Clothes Recognition and Retrieval with Rich Annotations , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Sébastien Thomassey,et al.  Sales Forecasting in Apparel and Fashion Industry: A Review , 2014 .

[38]  Kristen Grauman,et al.  Learning the Latent “Look”: Unsupervised Discovery of a Style-Coherent Embedding from Fashion Images , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[39]  Kristen Grauman,et al.  Dressing for Diverse Body Shapes , 2019, ArXiv.

[40]  Matthew Harding,et al.  Scalable Bayesian Non-negative Tensor Factorization for Massive Count Data , 2015, ECML/PKDD.

[41]  Kristen Grauman,et al.  Story-Driven Summarization for Egocentric Video , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Eric P. Xing,et al.  Discovering Pictorial Brand Associations from Large-Scale Online Image Data , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[43]  Anton van den Hengel,et al.  Image-Based Recommendations on Styles and Substitutes , 2015, SIGIR.

[44]  Wen-Huang Cheng,et al.  What Dress Fits Me Best?: Fashion Recommendation on the Clothing Style for Personal Body Shape , 2018, ACM Multimedia.

[45]  Serge J. Belongie,et al.  Learning Visual Clothing Style with Heterogeneous Dyadic Co-Occurrences , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[46]  Alexander C. Berg,et al.  Runway to Realway: Visual Analysis of Fashion , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[47]  Francesc Moreno-Noguer,et al.  Neuroaesthetics in fashion: Modeling the perception of fashionability , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Jiebo Luo,et al.  Mining Fashion Outfit Composition Using an End-to-End Deep Learning Approach on Set Data , 2016, IEEE Transactions on Multimedia.

[49]  Julian J. McAuley,et al.  Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering , 2016, WWW.

[50]  Shuicheng Yan,et al.  Clothes Co-Parsing Via Joint Image Segmentation and Labeling With Application to Clothing Retrieval , 2016, IEEE Transactions on Multimedia.

[51]  Yu Tsao,et al.  Dress With Style: Learning Style From Joint Deep Embedding of Clothing Styles and Body Shapes , 2020, IEEE Transactions on Multimedia.

[52]  Yutaka Satoh,et al.  Ten-Million-Order Human Database for World-Wide Fashion Culture Analysis , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[53]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[54]  Bo Zhao,et al.  Memory-Augmented Attribute Manipulation Networks for Interactive Fashion Search , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[55]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[56]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[57]  David J. Kriegman,et al.  From Bikers to Surfers: Visual Recognition of Urban Tribes , 2013, BMVC.

[58]  Xiaodan Liang,et al.  Layout-Graph Reasoning for Fashion Landmark Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[59]  Kristen Grauman,et al.  Creating Capsule Wardrobes from Fashion Images , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.