Trend Analysis is the custom of collecting information and attempting to spot a trend, or pattern, in the information. Trend analysis is often used to estimate future events, it could be used to approximate uncertain events in the past. Technical analysts and Technicians also uses market indicators of many types. Processing or analyzing the Trend in huge amount of data or extracting meaningful information is a challenging task. As the enterprises faced issues of gathering large chunks of data and analyzing the Trend .They found that the, data cannot be processed using any of the existing centralized architectures. One of the best open source tools used in the market to harness the distributed architecture in order to solve the data processing and analyzing problems is Apache Hadoop and Hive for querying best results. This paper addresses an experimental work on Trend analysis problem of big data and its optimal solution using Hadoop ecosystem, using parallel processing framework to process large data sets using Map Reduce programming and Apache Hive is a data warehouse infrastructure which is built on top of Hadoop for providing data summarization, querying and analysis.
[1]
K. V. Rama Satish,et al.
Big data processing with harnessing hadoop - MapReduce for optimizing analytical workloads
,
2014,
2014 International Conference on Contemporary Computing and Informatics (IC3I).
[2]
Chen Hau Wang,et al.
A Hadoop Based Weblog Analysis System
,
2014,
2014 7th International Conference on Ubi-Media Computing and Workshops.
[3]
Vaibhav Kohli,et al.
Big Data Processing using Apache Hadoop in Cloud System
,
2012
.
[4]
Sanjay Ghemawat,et al.
MapReduce: Simplified Data Processing on Large Clusters
,
2004,
OSDI.
[5]
Tom White,et al.
Hadoop: The Definitive Guide
,
2009
.
[6]
Rama Sathish K.V,et al.
An Approach to Optimize Q0S Scheduling for MapReduce in Big Data
,
2018
.
[7]
Muthu Dayalan,et al.
MapReduce : Simplified Data Processing on Large Cluster
,
2018
.