Development of Multiple Big Data Processing Platforms for Business Intelligence

The crucial problem of the integration of different platforms is how to adjust the distinct computing features between them with the capability of assigning an appropriate platform to best execute the inquire command. In business intelligence (BI), this paper introduced the integration of RHhadoop and SparkR platforms for the highperformance multiple big data processing platforms to carry out rapid data retrieval and data analysis with R programming. The goal of this paper is to design the optimization for job scheduling as well as to implement the optimized platform selection for highly improving the response time of data analysis. Alternatively, we proposed the very simple and straightforward manner for user to give R commands input instead of Java programming or Scala programming to realize the data retrieval or data analysis in the platforms. As a result, although the optimized platform selection can reduce the execution time for the data retrieval and data analysis significantly, furthermore scheduling optimization definitely increases the system efficiency a lot.