Convolutional Neural Networks for individual identification in the Southern Rock Lobster supply chain

In most traceability system, product identification is the key to enable the tracking activities along the supply chain to be carried out. Product tagging using barcode and RFID is the most common method for this purpose. However, these practices can be challenging for small businesses due to the cost and time burdens. In addition to this, concern of fraudulent activities such as cloning, substitution and reuse becomes a tangible risk in complicated and poor controlled markets. In approaching Southern Rock Lobster (SRL), this paper proposes an image-based identification solution for individuals using Convolutional Neural Networks (CNNs). This work is built on the prior research of automated lobster grading by the authors, with this next step working towards a low-cost biometric recognition solution for lobster tracking from catch to consumers. In this approach, a Siamese model combined with a contrastive loss function was adopted to distinguish between individual lobsters based on carapace images. These areas are believed to contain individually recognisable features formed by colours and spiny patterns. Preliminary experiments on an image dataset of 200 individual lobsters collected at a lobster processor show the feasibility of using lobster images as an additional factor to provide increased security to the current tag-based tracking systems in use within the SRL supply chain.

[1]  Aikaterini Mitrokotsa,et al.  Classifying RFID attacks and defenses , 2010, Inf. Syst. Frontiers.

[2]  Gang Wang,et al.  Gated Siamese Convolutional Neural Network Architecture for Human Re-identification , 2016, ECCV.

[3]  Ali Ismail Awad,et al.  From classical methods to animal biometrics: A review on cattle identification and tracking , 2016, Comput. Electron. Agric..

[4]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[5]  Hairulnizam Mahdin,et al.  Clone tag detection in distributed RFID systems , 2018, PloS one.

[6]  Amit Kumar Singh,et al.  Real-time recognition of cattle using animal biometrics , 2017, Journal of Real-Time Image Processing.

[7]  I. Tomasevic,et al.  Evaluation of poultry meat colour using computer vision system and colourimeter , 2019, British Food Journal.

[8]  Keith Martin,et al.  A Hierarchical Anti-Counterfeit Mechanism: Securing the Supply Chain Using RFIDs , 2013, FPS.

[9]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  R. Hanner,et al.  Chapter 2 – Seafood Traceability and Consumer Choice , 2016 .

[11]  Paul Turner,et al.  Traceability Systems for Wild Caught Lobster, Via Sense-T and Pathways to Market , 2017 .

[12]  Ilija Djekic,et al.  Comparison of a computer vision system vs. traditional colorimeter for color evaluation of meat products with various physical properties. , 2019, Meat science.

[13]  Joon Son Chung,et al.  VoxCeleb: A Large-Scale Speaker Identification Dataset , 2017, INTERSPEECH.

[14]  Václav Snásel,et al.  Biometric cattle identification approach based on Weber's Local Descriptor and AdaBoost classifier , 2016, Comput. Electron. Agric..

[15]  Lovekesh Vig,et al.  Siamese Networks for Chromosome Classification , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[16]  Knights Flexible shape models for image analysis in an automated lobster catch assessment system , 2007 .

[17]  Francis Butler,et al.  Assessment of retinal recognition technology as a biometric method for sheep identification , 2008 .

[18]  Chelsea Finn,et al.  Sloop: A pattern retrieval engine for individual animal identification , 2015, Pattern Recognit..

[19]  Mark P. Johnson,et al.  Comprehensive evaluation of passive tags show no adverse effects in an economically important crustacean , 2017 .

[20]  H. Kühl,et al.  Animal biometrics: quantifying and detecting phenotypic appearance. , 2013, Trends in ecology & evolution.

[21]  Luca Bertinetto,et al.  Fully-Convolutional Siamese Networks for Object Tracking , 2016, ECCV Workshops.

[22]  Y. Chang,et al.  Traceability in a food supply chain: Safety and quality perspectives , 2014 .

[23]  Lindu Zhao,et al.  Noncooperative bovine iris recognition via SIFT , 2013, Neurocomputing.

[24]  Michael W. Berns,et al.  Digital Image Processing and Analysis , 1986 .

[25]  Joel Scanlan,et al.  An application of Convolutional Neural Network to lobster grading in the Southern Rock Lobster supply chain , 2020 .

[26]  Shou-Ching Hsiao,et al.  Malware Image Classification Using One-Shot Learning with Siamese Networks , 2019, KES.

[27]  Yann LeCun,et al.  Signature Verification Using A "Siamese" Time Delay Neural Network , 1993, Int. J. Pattern Recognit. Artif. Intell..

[28]  Melvyn L. Smith,et al.  Towards on-farm pig face recognition using convolutional neural networks , 2018, Comput. Ind..

[29]  Walid I. Khedr SRFID: A hash-based security scheme for low cost RFID systems , 2013 .