Study of Fast Parallel Clustering Partition Algorithm for Large Data Sets

With the rapid increase of data amounts in clustering algorithms' processing,traditional K-Means clustering algorithm is facing huge challenge for large data sets.In order to improve efficiency of traditional K-Means clustering algorithm,this paper proposed some improvement ideas and implementation using the cluster center initialization and communication mode,according to parallel clustering algorithm based on MPI and distributed clustering algorithm based on Hadoop in cloud.The results show that research of the algorithm can reduce the communication and computation largely,and can have higher implementation efficiency.The research fruits will help us to design better and fast parallel clustering partition algorithm for large data sets in future.