MODSUM: Mitigation of Data Skew Using Mapper

Digitized India is utilized to interface country territories with fast Internet. Thus, it is utilized to decrease wrongdoing, manual power, documentation and furthermore builds the openings for work. These days' individuals are confronting numerous issues when they neglect to convey the driving permit and furthermore to diminish the debasement, the proposed framework consolidates the driving permit with dataskew. The points of interest of driving permit and dataskew information can be joined utilizing the MapReduce Counters. It consequently accumulated over Map and Reduce stages. It is utilized to make an apparatus that deals with the treatment of permit utilizing one of a kind recognizable proof related with every person. It encourages the client to movement different spots without having the permit. So the proposed framework will make the digitization of information on a huge scale for simple and fast access all through the India. Sqoop is a device expected to trade data among Hadoop and social databases. Sqoop uses MapReduce to import and fare the data, which gives parallel task and also adjustment to non-basic disappointment. As the after effect of parallel activities time usage for exchanging the information get diminished drastically.

[1]  Minyi Guo,et al.  On Traffic-Aware Partition and Aggregation in MapReduce for Big Data Applications , 2016, IEEE Transactions on Parallel and Distributed Systems.

[2]  Subhash Chandra,et al.  An Approach to Enhance the Performance of Hadoop MapReduce Framework for Big Data , 2016, 2016 International Conference on Micro-Electronics and Telecommunication Engineering (ICMETE).

[3]  Sankari Subbiah,et al.  Job starvation avoidance with alleviation of data skewness in Big Data infrastructure , 2017, 2017 2nd International Conference on Computing and Communications Technologies (ICCCT).

[4]  Patrick Th. Eugster,et al.  Optimal communication structures for big data aggregation , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[5]  Muhammad Younas,et al.  Transaction processing in consistency-aware user’s applications deployed on NoSQL databases , 2017, Human-centric Computing and Information Sciences.

[6]  Sandeep Kumar Hegde,et al.  A novel pattern classifier approach towards the performance optimization of Big Data analysis in distributed environment , 2017, 2017 Third International Conference on Advances in Electrical, Electronics, Information, Communication and Bio-Informatics (AEEICB).

[7]  Zhen Xiao,et al.  LIBRA: Lightweight Data Skew Mitigation in MapReduce , 2015, IEEE Transactions on Parallel and Distributed Systems.

[8]  Priya Gawande,et al.  Improving network traffic in MapReduce for big data applications , 2016, 2016 International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT).

[9]  Francisco Herrera,et al.  A first attempt on global evolutionary undersampling for imbalanced big data , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[10]  Neetu Singh,et al.  Comparison of data processing tools in hadoop , 2016, 2016 International Conference on Electrical, Electronics, Communication, Computer and Optimization Techniques (ICEECCOT).

[11]  Sunita Choudhary,et al.  Optimization of the search graph using Hadoop and Linux Operating System , 2017, 2017 International Conference on Nascent Technologies in Engineering (ICNTE).

[12]  Hong Zhang,et al.  MRapid: An Efficient Short Job Optimizer on Hadoop , 2017, 2017 IEEE International Parallel and Distributed Processing Symposium (IPDPS).

[13]  Ramez Elmasri,et al.  Quantitative Analysis of Scalable NoSQL Databases , 2016, 2016 IEEE International Congress on Big Data (BigData Congress).

[14]  Ahmet Sayar,et al.  MapReduce based scalable range query architecture for big spatial data , 2015, AICCSA 2015.

[15]  Siddharth Swarup Rautaray,et al.  Improvising name node performance by aggregator aided HADOOP framework , 2016, 2016 International Conference on Control, Instrumentation, Communication and Computational Technologies (ICCICCT).