Using Object Detection Technology to Identify Defects in Clothing for Blind People

Blind people often encounter challenges in managing their clothing, specifically in identifying defects such as stains or holes. With the progress of the computer vision field, it is crucial to minimize these limitations as much as possible to assist blind people with selecting appropriate clothing. Therefore, the objective of this paper is to use object detection technology to categorize and detect stains on garments. The defect detection system proposed in this study relies on the You Only Look Once (YOLO) architecture, which is a single-stage object detector that is well-suited for automated inspection tasks. The authors collected a dataset of clothing with defects and used it to train and evaluate the proposed system. The methodology used for the optimization of the defect detection system was based on three main components: (i) increasing the dataset with new defects, illumination conditions, and backgrounds, (ii) introducing data augmentation, and (iii) introducing defect classification. The authors compared and evaluated three different YOLOv5 models. The results of this study demonstrate that the proposed approach is effective and suitable for different challenging defect detection conditions, showing high average precision (AP) values, and paving the way for a mobile application to be accessible for the blind community.

[1]  Vítor H. Carvalho,et al.  Blind People: Clothing Category Classification and Stain Detection Using Transfer Learning , 2023, Applied Sciences.

[2]  A. Durmuşoğlu,et al.  Deep learning-based fabric defect detection: A review , 2022, Textile Research Journal.

[3]  H. Mcheick,et al.  Review of Navigation Assistive Tools and Technologies for the Visually Impaired , 2022, Sensors.

[4]  Jitendra V. Tembhurne,et al.  Object detection using YOLO: challenges, architectural successors, datasets and applications , 2022, Multimedia Tools and Applications.

[5]  T. Ahamed,et al.  Development of an Early Embryo Detection Methodology for Quail Eggs Using a Thermal Micro Camera and the YOLO Deep Learning Algorithm , 2022, Sensors.

[6]  Ahmed A. A. Osman,et al.  Evaluating the Forest Ecosystem through a Semi-Autonomous Quadruped Robot and a Hexacopter UAV , 2022, Sensors.

[7]  A. Durmuşoğlu,et al.  Classification of Defective Fabrics Using Capsule Networks , 2022, Applied Sciences.

[8]  Z. A. Aziz,et al.  Real-Time Plastic Surface Defect Detection Using Deep Learning , 2022, 2022 IEEE 12th Symposium on Computer Applications & Industrial Electronics (ISCAIE).

[9]  Xiaokang Fu,et al.  Fabric Defect Detection in Textile Manufacturing: A Survey of the State of the Art , 2021, Secur. Commun. Networks.

[10]  Daniel Rocha,et al.  A Model Approach for an Automatic Clothing Combination System for Blind People , 2020, Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering.

[11]  Yanxi Zhang,et al.  Surface Defects Detection of Car Door Seals Based on Improved YOLO V3 , 2021 .

[12]  Junfeng Jing,et al.  Fabric Defect Segmentation Method Based on Deep Learning , 2021, IEEE Transactions on Instrumentation and Measurement.

[13]  Tueng T. Shen,et al.  Causes of blindness and vision impairment in 2020 and trends over 30 years, and prevalence of avoidable blindness in relation to VISION 2020: the Right to Sight: an analysis for the Global Burden of Disease Study , 2020, The Lancet. Global health.

[14]  Ying Liu,et al.  Detecting Defects on Solid Wood Panels Based on an Improved SSD Algorithm , 2020, Sensors.

[15]  Huosheng Xie,et al.  A Robust Fabric Defect Detection Method Based on Improved RefineDet , 2020, Sensors.

[16]  Junfeng Jing,et al.  Mobile-Unet: An efficient convolutional neural network for fabric defect detection , 2020, Textile Research Journal.

[17]  Liming Wu,et al.  Research on Fabric Defect Detection Based on Deep Fusion DenseNet-SSD Network , 2020, Proceedings of the International Conference on Wireless Communication and Sensor Networks.

[18]  Khwaja Muinuddin Chisti Mohammed,et al.  Defective texture classification using optimized neural network structure , 2020, Pattern Recognit. Lett..

[19]  Hong-Yuan Mark Liao,et al.  YOLOv4: Optimal Speed and Accuracy of Object Detection , 2020, ArXiv.

[20]  Ha-Jin Yu,et al.  Fabric Defect Detection System Using Stacked Convolutional Denoising Auto-Encoders Trained with Synthetic Defect Data , 2020, Applied Sciences.

[21]  Jure Skvarč,et al.  Segmentation-based deep-learning approach for surface-defect detection , 2019, Journal of Intelligent Manufacturing.

[22]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[23]  Vítor Carvalho,et al.  Design of a Smart Mechatronic System to Combine Garments for Blind People: First Insights , 2019, HealthyIoT.

[24]  Vítor Carvalho,et al.  Extracting Clothing Features for Blind People Using Image Processing and Machine Learning Techniques: First Insights , 2019, VipIMAGE 2019.

[25]  Yang Lu,et al.  Artificial intelligence: a survey on evolution, models, applications and future trends , 2019, Journal of Management Analytics.

[26]  Matti Pietikäinen,et al.  Deep Learning for Generic Object Detection: A Survey , 2018, International Journal of Computer Vision.

[27]  Xindong Wu,et al.  Object Detection With Deep Learning: A Review , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Hong-wei Zhang,et al.  Yarn-dyed Fabric Defect Detection with YOLOV2 Based on Deep Convolution Neural Networks , 2018, 2018 IEEE 7th Data Driven Control and Learning Systems Conference (DDCLS).

[29]  Guojun Wen,et al.  Automatic Fabric Defect Detection with a Multi-Scale Convolutional Denoising Autoencoder Network Model , 2018, Sensors.

[30]  Vítor H. Carvalho,et al.  Development of an Automatic Combination System of Clothing Parts for Blind People : MyEyes , 2018 .

[31]  Daniel Rocha,et al.  MyEyes-automatic combination system of clothing parts to blind people: First insights , 2017, 2017 IEEE 5th International Conference on Serious Games and Applications for Health (SeGAH).

[32]  Khaled M. Elleithy,et al.  Sensor-Based Assistive Devices for Visually-Impaired People: Current Status, Challenges, and Future Directions , 2017, Sensors.

[33]  Vítor H. Carvalho,et al.  MyEyes - Automatic Combination System of Clothing Parts for Blind People: Prototype Validation , 2017 .

[34]  Р Ю Чуйков,et al.  Обнаружение транспортных средств на изображениях загородных шоссе на основе метода Single shot multibox Detector , 2017 .

[35]  Shyamanta M. Hazarika,et al.  An insight into assistive technology for the visually impaired and blind people: state-of-the-art and future trends , 2017, Journal on Multimodal User Interfaces.

[36]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[37]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Nancy A. Rudd,et al.  Dress, body and self: research in the social psychology of dress , 2014, Fashion and Textiles.

[40]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[41]  Luc Van Gool,et al.  The Pascal Visual Object Classes Challenge: A Retrospective , 2014, International Journal of Computer Vision.

[42]  A. Galinsky,et al.  Enclothed cognition , 2012 .

[43]  N. H. C. Yung,et al.  Automated fabric defect detection - A review , 2011, Image Vis. Comput..

[44]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[45]  Michiel R de Boer,et al.  Impact of Visual Impairment on Quality of Life: A Comparison With Quality of Life in the General Population and With Other Chronic Conditions , 2007, Ophthalmic epidemiology.

[46]  P. Mitchell,et al.  Assessment of Vision-Related Quality of Life in an Older Population Subsample: The Blue Mountains Eye Study , 2006, Ophthalmic epidemiology.