Study on Similarity Compute and File Filtering Based on Cloud Computing Method

Text similarity computing has been widely used in confidential document filtering to enhance the safety of an enterprise information system. And the accuracy rate and performance of the similarity computing has always been the crucial problem in the research of document filtering. With the approaching era of massive data, the traditional way of computing similarity can not meet the needs of enterprises any more, but new ideas can be put forward in cloud computing environment. Aiming to solve this problem, this paper presents an algorithm of computing the distributed similarity which is based on mutual information document in cloud computing environment. This algorithm can calculate the text similarity based on cloud computing environment, and the calculations can be used to achieve the document filtering function. We’ve lanuched some experiments in Hadoop cloud computing environment, and the results show that this algorithm is a high-performance and effective algorithm.