Big Data: Framework and issues

Nowadays, many industries and governments around the world are experiencing unprecedented increase in the volume, variety and velocity of information, due to the deployment of the new generations of mobile networks, increased use of smartphones, the explosion of numbers of subscribers, the multitude of services offered, online transactions and the rise of social media. These massive data is considered a gold mine that must be tapped to enjoy, to do this, Big Data proves the most appropriate technology. Big Data allows data analysis in immeasurable depths, highlights the hidden meanings in data tsunami, it brings up information by showing correlations, the underlying mechanisms of unsuspected associations and shows things in a new and unexpected angle. Business organizations using Big Data will differentiate themselves from their competitors, gain market share, achieve key objectives, increase revenue and benefit from new innovative services. This paper introduces Big Data technology along with its importance in the modern world and highlights its key fields and substantial issues. It also discusses Big Data tools (Hadoop and Spark) in detail and compares them according to several criteria. The paper concludes with big data's storage and privacy issues.

[1]  K. Bakshi,et al.  Considerations for big data: Architecture and approach , 2012, 2012 IEEE Aerospace Conference.

[2]  John A. Keane,et al.  Big Data Framework , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[3]  Punam Bedi,et al.  Beginning with big data simplified , 2014, 2014 International Conference on Data Mining and Intelligent Computing (ICDMIC).

[4]  Miriam A. M. Capretz,et al.  Challenges for MapReduce in Big Data , 2014, 2014 IEEE World Congress on Services.

[5]  Avita Katal,et al.  Big data: Issues, challenges, tools and Good practices , 2013, 2013 Sixth International Conference on Contemporary Computing (IC3).

[6]  Samuel Madden,et al.  From Databases to Big Data , 2012, IEEE Internet Comput..

[8]  Alvaro A. Cárdenas,et al.  Big Data Analytics for Security , 2013, IEEE Security & Privacy.

[9]  Shankar Ganesh Manikandan,et al.  Big Data Analysis Using Apache Hadoop , 2014, 2014 International Conference on IT Convergence and Security (ICITCS).

[10]  Taoying Li,et al.  Opportunities of innovation under challenges of big data , 2013, 2013 10th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[11]  J. Béranger Big Data et données personnelles: vers une gouvernance éthique des algorithmes , 2014 .

[12]  Seref Sagiroglu,et al.  Big data: A review , 2013, 2013 International Conference on Collaboration Technologies and Systems (CTS).

[13]  Palak Gupta,et al.  An approach towards big data — A review , 2015, International Conference on Computing, Communication & Automation.