Research on mixed tasks scheduling in YARN

YARN provides support for a variety of computing frameworks and different types of jobs, different types of computing tasks and jobs can be run on the YARN platform, different job types can divided into batch jobs and interactive jobs. As for the single job, it can be divided into three kinds: the small job, the middle job and the big job. Based on the different combinations and quantities of these assignments, this paper divides the assignments into single, mixed, and batch jobs, simulates interactive jobs with batch small jobs and simulates batch jobs with batch big jobs. And the paper studies the influence of different scheduling strategies on the implementation of different job types. Experiments show that for the interactive job, the performance of Fair scheduler is better than Capacity; for batch job, under the premise of resources are not limited, Fair is also better than the performance of Capacity.