Real-Time Image Segmentation using Neuromorphic Pixel Array

Image segmentation is a critical step in achieving computer vision. For fast and near real time image segmentation it is important to use dedicated hardware as it works much faster as compared to software based solutions. This paper presents a CMOS based real time image segmentation analog circuit using semi-supervised learning scheme. The proposed circuit ensures minimal operating power required when compared to its digital hardware implementation due to sub-threshold region operation of MOSFET and much lesser number of transistors being used. The circuit operation is based upon an anisotropic current spreading in non linear circuits. An analog pixel array is created which takes in weights and initial seed as input and segments the image based on them. Weights are generated from an image based on the feature similarity and are then fed to the pixel array. These weights dictate the anisotropic diffusion of current in the analog array and thus required segmentation is achieved. The proposed analog circuit based segmentation scheme is highly power efficient as compared to digital hardware implementation. Thus this scheme can be used in a power constrained environment as in case of Internet of Things (IoTs) network with independent battery-less nodes. Our approach will also be suitable for applications that require highperformance computing to run in real time, such as biomedical image segmentation for image-guided surgery.

[1]  Gert Cauwenberghs,et al.  Neuromorphic Silicon Neuron Circuits , 2011, Front. Neurosci.

[2]  André van Schaik,et al.  A Low Power Trainable Neuromorphic Integrated Circuit That Is Tolerant to Device Mismatch , 2016, IEEE Transactions on Circuits and Systems I: Regular Papers.

[3]  William A. Barrett,et al.  Interactive Segmentation with Intelligent Scissors , 1998, Graph. Model. Image Process..

[4]  Christof Koch,et al.  Analog VLSI motion discontinuity detectors for image segmentation , 1996, 1996 IEEE International Symposium on Circuits and Systems. Circuits and Systems Connecting the World. ISCAS 96.

[5]  K. Schwan,et al.  FPGA based real-time image segmentation for medical systems and data processing , 2005, 14th IEEE-NPSS Real Time Conference, 2005..

[6]  Jayaram K. Udupa,et al.  An ultra-fast user-steered image segmentation paradigm: live wire on the fly , 2000, IEEE Transactions on Medical Imaging.

[7]  Gert Cauwenberghs,et al.  Large-Scale Neuromorphic Spiking Array Processors: A Quest to Mimic the Brain , 2018, Front. Neurosci..

[8]  Ettore Napoli,et al.  FPGA-based architecture for real time segmentation and denoising of HD video , 2013, Journal of Real-Time Image Processing.

[9]  Supun Samarasekera,et al.  User-steered image boundary segmentation , 1996, Medical Imaging.

[10]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Ralph Etienne-Cummings,et al.  An Analogue Neuromorphic Co-Processor That Utilizes Device Mismatch for Learning Applications , 2018, IEEE Transactions on Circuits and Systems I: Regular Papers.

[12]  Ralph Etienne-Cummings,et al.  Real-time image segmentation using a spiking neuromorphic processor , 2017, 2017 51st Annual Conference on Information Sciences and Systems (CISS).

[13]  John G. Harris,et al.  An analog network for continuous-time segmentation , 1993, International Journal of Computer Vision.

[14]  Eric A. Vittoz,et al.  Analog VLSI signal processing: Why, where, and how? , 1994 .

[15]  Tobi Delbriick "Bump" Circuits for Computing Similarity and Dissimilarity of Analog Voltages , 1991 .

[16]  Sankar K. Pal,et al.  A review on image segmentation techniques , 1993, Pattern Recognit..

[17]  Peter G. Doyle,et al.  Random Walks and Electric Networks: REFERENCES , 1987 .

[18]  N. Arunkumar,et al.  Convolutional neural network for bio-medical image segmentation with hardware acceleration , 2018, Cognitive Systems Research.

[19]  Yousef Saad,et al.  Parallel Iterative Methods for Sparse Linear Systems , 2001 .