A survey paper on big data analytics

In recent years, the internet application and communication have seen a lot of development and reputation in the field of Information Technology. These internet applications and communication are continually generating the large size, different variety and with some genuine difficult multifaceted structure data called big data. As a consequence, we are now in the era of massive automatic data collection, systematically obtaining many measurements, not knowing which one will be relevant to the phenomenon of interest. For example, E-commerce transactions include activities such as online buying, selling or investing. Thus they generate the data which are high in dimensional and complex in structure. The traditional data storage techniques are not adequate to store and analyses those huge volume of data. Many researchers are doing their research in dimensionality reduction of the big data for effective and better analytics report and data visualization. Hence, the aim of the survey paper is to provide the overview of the big data analytics, issues, challenges and various technologies related with Big Data.

[1]  R. Kitchin The real-time city? Big data and smart urbanism , 2013 .

[2]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[3]  Kord Davis Ethics of Big Data: Balancing Risk and Innovation , 2012 .

[4]  Krish Krishnan,et al.  Data Warehousing in the Age of Big Data , 2013 .

[5]  Katharine Armstrong,et al.  Big data: a revolution that will transform how we live, work, and think , 2014 .

[6]  Bo Song,et al.  A novel dimensionality reduction algorithm based on Laplace matrix for microbiome data analysis , 2015, 2015 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[7]  Weiguo Fan,et al.  Effective and efficient dimensionality reduction for large-scale and streaming data preprocessing , 2006, IEEE Transactions on Knowledge and Data Engineering.

[8]  Zahir Tari,et al.  A Survey of Clustering Algorithms for Big Data: Taxonomy and Empirical Analysis , 2014, IEEE Transactions on Emerging Topics in Computing.

[9]  Zhen Li,et al.  CloudVista: Interactive and Economical Visual Cluster Analysis for Big Data in the Cloud , 2012, Proc. VLDB Endow..

[10]  Katrina Sin,et al.  Application of Big Data in Education Data Mining and Learning Analytics-A Literature Review , 2015, SOCO 2015.

[11]  Ch. Aswani Kumar,et al.  A Note on the Effect of Term Weighting on Selecting Intrinsic Dimensionality of Data , 2009 .

[12]  Veda C. Storey,et al.  Business Intelligence and Analytics: From Big Data to Big Impact , 2012, MIS Q..

[13]  Pascal Frossard,et al.  Structured Dimensionality Reduction for Additive Model Regression , 2016, IEEE Transactions on Knowledge and Data Engineering.

[14]  Viktor Mayer-Schnberger,et al.  Big Data: A Revolution That Will Transform How We Live, Work, and Think , 2013 .

[15]  Christophe Nicolle,et al.  Understandable Big Data: A survey , 2015, Comput. Sci. Rev..

[16]  Xueming Qian,et al.  Personalized Travel Sequence Recommendation on Multi-Source Big Social Media , 2016, IEEE Transactions on Big Data.

[17]  Vallabh Dhoot,et al.  Efficient Dimensionality Reduction for Big Data Using Clustering Technique , 2016 .

[18]  Geoffrey C. Fox,et al.  Dimension reduction and visualization of large high-dimensional data via interpolation , 2010, HPDC '10.