Implementation of Unsupervised k-Means Clustering Algorithm Within Amazon Web Services Lambda

This work demonstrates how an unsupervised learning algorithm based on k-Means Clustering with Kaufman Initialization may be implemented effectively as an Amazon Web Services Lambda Function, within their serverless cloud computing service. It emphasizes the need to employ a lean and modular design philosophy, transfer data efficiently between Lambda and DynamoDB, as well as employ Lambda Functions within mobile applications seamlessly and with negligible latency. This work presents a novel application of serverless cloud computing and provides specific examples that will allow readers to develop similar algorithms. The author provides compares the computation speed and cost of machine learning implementations on traditional PC and mobile hardware (running locally) as well as implementations that employ Lambda.

[1]  Bilal Malik,et al.  Cloud Computing with Machine Learning Could Help Us in the Early Diagnosis of Breast Cancer , 2015, 2015 Second International Conference on Advances in Computing and Communication Engineering.

[2]  John Herbert,et al.  Adaptive Cost Efficient Framework for Cloud-Based Machine Learning , 2017, 2017 IEEE 41st Annual Computer Software and Applications Conference (COMPSAC).

[3]  A.I. Khan,et al.  An agent based approach to discovery and formation of the serverless core network , 2005, 2005 13th IEEE International Conference on Networks Jointly held with the 2005 IEEE 7th Malaysia International Conf on Communic.

[4]  Paul R. Brenner,et al.  Serverless Computing: Design, Implementation, and Performance , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems Workshops (ICDCSW).

[5]  Ali S. Hadi,et al.  Finding Groups in Data: An Introduction to Chster Analysis , 1991 .

[6]  Jiebo Luo,et al.  Image segmentation via adaptive K-mean clustering and knowledge-based morphological operations with biomedical applications , 1998, IEEE Trans. Image Process..

[7]  K. Venkatesh Sharma,et al.  Mitigating Denial-of-Service Attacks on the Chord Overlay Network: A Location Hiding Approach , 2010 .

[8]  Adam Eivy,et al.  Be Wary of the Economics of "Serverless" Cloud Computing , 2017, IEEE Cloud Computing.

[9]  Fuchun Sun,et al.  Efficient and Rapid Machine Learning Algorithms for Big Data and Dynamic Varying Systems , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[10]  Vatche Ishakian,et al.  Serverless Programming (Function as a Service) , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS).

[11]  Shucheng Yu,et al.  Privacy Preserving Back-Propagation Neural Network Learning Made Practical with Cloud Computing , 2014, IEEE Transactions on Parallel and Distributed Systems.

[12]  Pascal Daragon,et al.  Serverless lightweight mutual authentication protocol for small mobile computing devices , 2015, 2015 7th International Conference on New Technologies, Mobility and Security (NTMS).

[13]  Peter J. Rousseeuw,et al.  Finding Groups in Data: An Introduction to Cluster Analysis , 1990 .

[14]  Andrea C. Arpaci-Dusseau,et al.  Pipsqueak: Lean Lambdas with Large Libraries , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems Workshops (ICDCSW).

[15]  Salvatore Venticinque,et al.  A Negotiation Solution for Smart Grid Using a Fully Decentralized, P2P Approach , 2015, 2015 Ninth International Conference on Complex, Intelligent, and Software Intensive Systems.

[16]  Cheng-Zhong Xu,et al.  Coordinated Self-Configuration of Virtual Machines and Appliances Using a Model-Free Learning Approach , 2013, IEEE Transactions on Parallel and Distributed Systems.

[17]  Castro Paul,et al.  Cloud-Native, Event-Based Programming for Mobile Applications , 2016 .

[18]  Kevin Li,et al.  Assessment of machine learning algorithms in cloud computing frameworks , 2013, 2013 IEEE Systems and Information Engineering Design Symposium.

[19]  Stephen Ennis,et al.  Cloud Event Programming Paradigms: Applications and Analysis , 2016, 2016 IEEE 9th International Conference on Cloud Computing (CLOUD).

[20]  Jiye Liang,et al.  An initialization method for the K-Means algorithm using neighborhood model , 2009, Comput. Math. Appl..