Apparatus for Task Distribution and Parallel Processing System and Method there of
暂无分享,去创建一个
The present invention discloses a task distribution processing system and parallel with the method. Task allocation and parallel processing system according to the present invention, operation care device of the user and distributed to the one or more tasks in the node by dividing the requested operation into a predetermined size map (Map) of a task; And within each of the one or more tasks in the node, after each parallel processing of each task of the distribution in a multi-threaded, that is characterized in including a Map task executor generating intermediate results file to integrate. The present invention is in the task distributed to the user requested operation in consideration of the parallel processing aspect of the nodes, and multi-core central processing unit assigned the Map task by task thread group, share the intermediate result files for individual Map task, a node less system load, thereby improving the system speed to the parallel distributed processing of multiple tasks on. Distributed parallel processing tasks, multi-core, an intermediate result files, threads, MapReduce
[1] Christoforos E. Kozyrakis,et al. Evaluating MapReduce for Multi-core and Multiprocessor Systems , 2007, 2007 IEEE 13th International Symposium on High Performance Computer Architecture.