Dual-Branch CNN for the Identification of Recyclable Materials

The classification of recyclable materials, and in particular the recovery of plastic, plays an important role in the economy, but also in environmental sustainability. This study presents a novel image classification model that can be efficiently used to distinguish recyclable materials. Building on recent work in deep learning and waste classification, we introduce the so-called “Dual-branch Multi-output CNN”, a custom convolutional neural network composed of two branches aimed to i) classify recyclables and ii) distinguish the type of plastic. The proposed architecture is composed of two classifiers trained on two different datasets, so as to encode complementary attributes of the recyclable materials. In our work, the Densenet121, ResNet50 and VGG16 architectures were used on the Trashnet dataset, along with data augmentation techniques, as well as on the WaDaBa dataset with physical variation techniques. In particular, our approach makes use of the joint utilization of the datasets, allowing the learning of disjoint label combinations. Our experiments confirm its effectiveness in the classification of waste material.

[1]  Qian Du,et al.  Multisource Remote Sensing Data Classification Based on Convolutional Neural Network , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Zenghui Wang,et al.  Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review , 2017, Neural Computation.

[3]  Gary Thung,et al.  Classification of Trash for Recyclability Status , 2016 .

[4]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Gaurav Mittal,et al.  SpotGarbage: smartphone app to detect garbage using deep learning , 2016, UbiComp.

[6]  Jose Tan,et al.  Literature Review of Automated Waste Segregation System Using Machine Learning: A Comprehensive Analysis , 2019, International journal of simulation: systems, science & technology.

[7]  Norikazu Takahashi,et al.  Ensemble learning in CNN augmented with fully connected subnetworks , 2020, ArXiv.

[8]  R. Raskar,et al.  Splintering with distributions and polytopes: Unconventional schemes for private computation , 2020 .

[9]  Chris Yakopcic,et al.  A State-of-the-Art Survey on Deep Learning Theory and Architectures , 2019, Electronics.

[10]  Yue Cao,et al.  Transferable Representation Learning with Deep Adaptation Networks , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Mariusz Kubanek,et al.  The triple histogram method for waste classification , 2020 .

[13]  Geoffrey E. Hinton,et al.  Distilling the Knowledge in a Neural Network , 2015, ArXiv.

[14]  David W. Capson,et al.  Towards real-time sorting of recyclable goods using support vector machines , 2011, Proceedings of the 2011 IEEE International Symposium on Sustainable Systems and Technology.

[15]  Janusz Bobulski,et al.  PET Waste Classification Method and Plastic Waste DataBase - WaDaBa , 2017, IP&C.

[16]  Jianjun Hu,et al.  An Ensemble Stacked Convolutional Neural Network Model for Environmental Event Sound Recognition , 2018, Applied Sciences.

[17]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[18]  Cenk Bircanoglu,et al.  RecycleNet: Intelligent Waste Sorting Using Deep Neural Networks , 2018, 2018 Innovations in Intelligent Systems and Applications (INISTA).

[19]  Murat Haciomeroglu,et al.  Classification of TrashNet Dataset Based on Deep Learning Models , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[20]  Yurong Liu,et al.  A survey of deep neural network architectures and their applications , 2017, Neurocomputing.

[21]  David H. Wolpert,et al.  Stacked generalization , 1992, Neural Networks.

[22]  Angus G. Forbes,et al.  CompostNet: An Image Classifier for Meal Waste , 2019, 2019 IEEE Global Humanitarian Technology Conference (GHTC).

[23]  Xiaogang Xiong,et al.  Multilayer Hybrid Deep-Learning Method for Waste Classification and Recycling , 2018, Comput. Intell. Neurosci..

[24]  Kilian Q. Weinberger,et al.  On Calibration of Modern Neural Networks , 2017, ICML.

[25]  Eduardo A. Soares,et al.  Artificial Intelligence in Automated Sorting in Trash Recycling , 2018, Anais do XV Encontro Nacional de Inteligência Artificial e Computacional (ENIAC 2018).

[26]  Bo Pu,et al.  Consumer’s Waste Classification Intention in China: An Extended Theory of Planned Behavior Model , 2019 .

[27]  Silvia Serranti,et al.  Innovative Recognition-Sorting Procedures Applied to Solid Waste: The Hyperspectral Approach , 2009 .

[28]  Ramesh Raskar,et al.  Split learning for health: Distributed deep learning without sharing raw patient data , 2018, ArXiv.

[29]  Gabriela Csurka,et al.  Domain Adaptation for Visual Applications: A Comprehensive Survey , 2017, ArXiv.

[30]  Yizhou Yu,et al.  Borrowing Treasures from the Wealthy: Deep Transfer Learning through Selective Joint Fine-Tuning , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Blaise Agüera y Arcas,et al.  Communication-Efficient Learning of Deep Networks from Decentralized Data , 2016, AISTATS.

[32]  Qihao Weng,et al.  A survey of image classification methods and techniques for improving classification performance , 2007 .

[33]  Sumit Chopra,et al.  DLID: Deep Learning for Domain Adaptation by Interpolating between Domains , 2013 .

[34]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[35]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.