Multi-Layer Perceptron-based Classification of Recyclable Plastics from Waste using Hyperspectral Imaging for Robotic Sorting

Abstract: Rapid usage of plastics is a threat to the environment because of their higher persistence in the environment. Automatic Sorting of various kinds of plastics from a waste stream using robot manipulators is preferable as manual sorting is time-consuming and hazardous to the workers involved. We propose the use of hyperspectral imaging with a wider wavelength range in the NIR-zone in conjunction with advanced computing for detecting the recyclable plastics in the mixed waste stream. This paper presents an algorithmic approach based on entropy and contrast stretching for performing image segmentation to obtain pixel clusters representing distinct objects in a given Hyperspectral Image. Obtained pixel clusters with known class labels are used to train a Multi-Layer Perceptron (MLP) neural network model. The trained model is used for the accurate classification (reported 98.2% accuracy on test data) of pixel clusters from unknown waste stream sample images. In the future, we plan to integrate a robotic pick-and-place system for automated sorting and thereafter scale up the developed system to automate the sorting operation in the plastic recycling centers or material recovery facilities (MRF).

[1]  Meijun Sun,et al.  How to predict the sugariness and hardness of melons: A near-infrared hyperspectral imaging method. , 2017, Food chemistry.

[2]  Shintaroh Ohashi,et al.  Detection of external insect infestations in jujube fruit using hyperspectral reflectance imaging , 2011 .

[3]  J. Qin,et al.  Detection of citrus canker using hyperspectral reflectance imaging with spectral information divergence , 2009 .

[4]  S. Hait,et al.  Plastics in the time of COVID-19 pandemic: Protector or polluter? , 2020, Science of The Total Environment.

[5]  Chenghai Yang,et al.  Yield Estimation from Hyperspectral Imagery Using Spectral Angle Mapper (SAM) , 2008 .

[6]  Silvia Serranti,et al.  Characterization of microplastic litter from oceans by an innovative approach based on hyperspectral imaging. , 2018, Waste management.

[7]  John R. Jensen,et al.  Vegetation Cover Analysis of Hazardous Waste Sites in Utah and Arizona Using Hyperspectral Remote Sensing , 2012, Remote. Sens..

[8]  Fei Liu,et al.  Ripeness Classification of Astringent Persimmon Using Hyperspectral Imaging Technique , 2014, Food and Bioprocess Technology.

[9]  Christophe Claramunt,et al.  A Spatial Form of Diversity , 2005, COSIT.

[10]  F. Meer The effectiveness of spectral similarity measures for the analysis of hyperspectral imagery , 2006 .

[11]  Daniel Hoornweg,et al.  What a waste? : a global review of solid waste management , 2012 .

[12]  Nikolaos Doulamis,et al.  Deep supervised learning for hyperspectral data classification through convolutional neural networks , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[13]  Jun Zhou,et al.  Material Based Object Tracking in Hyperspectral Videos , 2018, IEEE Transactions on Image Processing.

[14]  Yan Zheng,et al.  A discrimination model in waste plastics sorting using NIR hyperspectral imaging system. , 2018, Waste management.

[15]  Atul Thakur,et al.  A review on automated sorting of source-separated municipal solid waste for recycling. , 2017, Waste management.

[16]  Vincent Baeten,et al.  Hyperspectral Imaging Applications in Agriculture and Agro-Food Product Quality and Safety Control: A Review , 2013 .