A real time processing and streaming of wireless network data using Storm

Growth of the Internet, Lead to Cloud Computing, Mobile Network and Internet of Things increasing rapidly, big data is becoming a hot-spot in recent years. Data generated from many sources made huge demand for storing, managing, processing and querying on various stream. This gives rise to data processing in our daily life such as mobile devices, RFID and Wireless sensors, which aims at dealing with billions of users interactive data. At real time processing is intently needed integrated system. An entire system is built on one such application Storm, associated with Sql Stream. In this survey use this static data stream and some logs stream and also click stream to show some basic result. To ensure the practical applicability and high efficiency, A Simulation System is established and shown acceptable performance in various expressions using data sheet. It proved that data analysis system for stream and real time processing based on storm can be used in various computing environment.

[1]  Chao Wang,et al.  Sedna: A Memory Based Key-Value Storage System for Realtime Processing in Cloud , 2012, 2012 IEEE International Conference on Cluster Computing Workshops.

[2]  Tom White,et al.  Hadoop: The Definitive Guide , 2009 .

[3]  Saeed Shahrivari,et al.  Beyond Batch Processing: Towards Real-Time and Streaming Big Data , 2014, Comput..

[4]  Simon Fong,et al.  Incremental Optimization Mechanism for Constructing a Decision Tree in Data Stream Mining , 2013 .

[5]  Geoff Hulten,et al.  Mining complex models from arbitrarily large databases in constant time , 2002, KDD.

[6]  P. Bagade,et al.  Designing performance monitoring tool for NoSQL Cassandra distributed database , 2012, International Conference on Education and e-Learning Innovations.

[7]  Michael J. Franklin,et al.  Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing , 2012, NSDI.

[8]  Madhusudhan Govindaraju,et al.  An Evaluation of Cassandra for Hadoop , 2013, 2013 IEEE Sixth International Conference on Cloud Computing.

[9]  Laurence T. Yang,et al.  Big Data Real-Time Processing Based on Storm , 2013, 2013 12th IEEE International Conference on Trust, Security and Privacy in Computing and Communications.