Osmotic Collaborative Computing for Machine Learning and Cybersecurity Applications in Industrial IoT Networks and Cyber Physical Systems with Gaussian Mixture Models

To implement machine learning algorithms and other useful algorithms in industrial Internet of Things (IIoT), new computing approaches are needed to prevent costs associated with having to install state of the art edge analytic devices. A suitable approach may include collaborative edge computing using available, resource-constrained IoT edge analytic hardware. In this paper, collaborative computing method is used to construct a popular and very useful waveform for IoT analytics, the Gaussian Mixture Model (GMM). GMM parameters are learned in the cloud, but the GMMs are constructed at the IIoT edge layer. GMMs are constructed using C28x, a ubiquitous, low-cost, embedded digital signal processor (DSP) that is widely available in many pre-existing IIoT infrastructures and in many edge analytic devices. Several GMMs including 2-GMM and 3-GMMs are constructed using the C28x DSP and Embedded C to show that GMM designs could be achieved in form of an osmotic microservice from the IIoT edge to the IIoT fog layer. Designed GMMs are evaluated using their differential and zero-crossings and are found to satisfy important waveform design criteria. At the fog layer, constructed GMMs are then applied for novelty detection, an IIoT cybersecurity and fault-monitoring application and are found to be able to detect anomalies in IIoT machine data using Hampel identifier, 3-Sigma rule, and the Boxplot rule. The osmotic collaborative computing method advocated in this paper will be crucial in ensuring the possibility of shifting many complex applications such as novelty detection and other machine learning based cybersecurity applications to edges of large scale IoT networks using low-cost widely available DSPs.

[1]  Kaushik Roy,et al.  Scalable Effort Hardware Design , 2014, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[2]  Tao Zhang,et al.  The emerging era of fog computing and networking [The President's Page] , 2016, IEEE Commun. Mag..

[3]  Emmanuel Oyekanlu,et al.  Real-Time Distributed Computing at Network Edges for Large Scale Industrial IoT Networks , 2018, 2018 IEEE World Congress on Services (SERVICES).

[4]  S.K. Sanyal,et al.  Design of Arbitrary Waveform Generator based on Direct Digital Synthesis Technique using Code Composer Studio Platform , 2007, 2007 International Symposium on Signals, Circuits and Systems.

[5]  S.K. Sanyal,et al.  A Novel Technique for the Generation of Good Quality Tunable Sinusoid based on DDS using Digital Signal Processor , 2006, 2006 2nd International Conference on Information & Communication Technologies.

[6]  A. Ardeshir Goshtasby,et al.  Curve Fitting by a Sum of Gaussians , 1994, CVGIP Graph. Model. Image Process..

[7]  Badrish Chandramouli,et al.  Enabling Signal Processing over Data Streams , 2017, SIGMOD Conference.

[8]  Dinesh C. Verma,et al.  Measures of network centricity for edge deployment of IoT applications , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[9]  Wenyu Jiang,et al.  Efficient implementation of Gaussian Mixture Models using vote count circuit , 2014, Signal and Information Processing Association Annual Summit and Conference (APSIPA), 2014 Asia-Pacific.

[10]  B. Lehman,et al.  Outlier detection rules for fault detection in solar photovoltaic arrays , 2013, 2013 Twenty-Eighth Annual IEEE Applied Power Electronics Conference and Exposition (APEC).

[11]  Paolo Pennacchi,et al.  Diagnostic Significance of Orbit Shape Analysis and its Application to Improve Machine Fault Detection , 2004 .

[12]  Bob H. Lee,et al.  Real-Time Digital Signal Processing: Implementations, Applications, and Experiments with the Tms320c55x , 2001 .

[13]  Manish Bhardwaj,et al.  Sensorless Field Oriented Control of Multiple Permanent Magnet Motors , 2013 .

[14]  Mike Amundsen,et al.  Microservice Architecture: Aligning Principles, Practices, and Culture , 2016 .

[15]  Lianping Chen,et al.  Microservices: Architecting for Continuous Delivery and DevOps , 2018, 2018 IEEE International Conference on Software Architecture (ICSA).

[16]  Rosangela de Fatima Pereira,et al.  Fog computing: Data analytics and cloud distributed processing on the network edges , 2016, 2016 35th International Conference of the Chilean Computer Science Society (SCCC).

[17]  6 – Gas turbine combustion , 2007 .

[18]  Wenyu Jiang,et al.  Enhanced vote count circuit based on nor flash memory for fast similarity search , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  Nitinder Mohan,et al.  Edge-Fog cloud: A distributed cloud for Internet of Things computations , 2016, 2016 Cloudification of the Internet of Things (CIoT).

[20]  Rajiv Ranjan,et al.  Osmotic Computing: A New Paradigm for Edge/Cloud Integration , 2016, IEEE Cloud Computing.

[21]  Yannis Soupionis,et al.  Gaussian Mixture Modeling for Detecting Integrity Attacks in Smart Grids , 2016 .

[22]  M. Shamim Hossain,et al.  Fog Intelligence for Real-Time IoT Sensor Data Analytics , 2017, IEEE Access.

[23]  Guangwen Yang,et al.  A Fully-Pipelined Hardware Design for Gaussian Mixture Models , 2017, IEEE Transactions on Computers.

[24]  Nhat Ho,et al.  Identifiability and optimal rates of convergence for parameters of multiple types in finite mixtures , 2015, 1501.02497.

[25]  Miguel Delgado Prieto,et al.  Evaluation of Novelty Detection Methods for Condition Monitoring applied to an Electromechanical System , 2017 .

[26]  Anisha Gupta,et al.  Scalability in Internet of Things : Features , Techniques and Research Challenges , 2017 .

[27]  Rajiv Ranjan,et al.  Osmotic Flow: Osmotic Computing + IoT Workflow , 2017, IEEE Cloud Computing.

[28]  Xinghuo Yu,et al.  Smart Grids: A Cyber–Physical Systems Perspective , 2016, Proceedings of the IEEE.

[29]  Prem Prakash Jayaraman,et al.  Osmotic Monitoring of Microservices between the Edge and Cloud , 2018, 2018 IEEE 20th International Conference on High Performance Computing and Communications; IEEE 16th International Conference on Smart City; IEEE 4th International Conference on Data Science and Systems (HPCC/SmartCity/DSS).

[30]  Sigrid Schefer-Wenzl,et al.  A Highly Scalable IoT Architecture through Network Function Virtualization , 2017, Open J. Internet Things.

[31]  Jindrich Liska,et al.  The Use of Time-Frequency Methods in Rotor/Stator Impact-Rubbing Detection , 2011 .

[32]  Ann Gordon-Ross,et al.  Microprocessor Optimizations for the Internet of Things: A Survey , 2016, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[33]  Zhuo Chen,et al.  Edge Analytics in the Internet of Things , 2015, IEEE Pervasive Computing.

[34]  Emmanuel Oyekanlu,et al.  Towards statistical machine learning for edge analytics in large scale networks: Real-time Gaussian function generation with generic DSP , 2018, 2018 First International Colloquium on Smart Grid Metrology (SmaGriMet).