Sensor networks are widely used in various environment monitoring systems. For example, in storehouse, it is used for monitoring the temperature, humidity, and carbon dioxide level inside the storehouse. Those sensing values are packaged in relatively small data, only around 100 bytes. However, we want to get those sensing values periodically every a certain cycle; every several seconds or minutes depending on the system requirement. And since in a storehouse sensor network there might be hundreds of storehouse and thousands of sensor nodes, resulting in millions of sensor data over only one day (depending on the cycle length), we are facing tremendous number of data access into the file system; using the naive onedata one-file storing mechanism. In this paper, we are trying to design a data input system which collect and combine those individuals of sensor data into a big chunk of file and store it in HDFS, while using MapReduce framework to access and process those chunks inside HDFS.
[1]
K. Martinez,et al.
Robust wireless sensor network performance analysis
,
2011,
2011 IEEE SENSORS Proceedings.
[2]
Yu Tian,et al.
Design and Application of Wireless Sensor Networks for Ground Verification of Remote Sensing
,
2008,
2008 International Conference on Apperceiving Computing and Intelligence Analysis.
[3]
Annett Laube,et al.
Ontological Middleware for Dynamic Wireless Sensor Data Processing
,
2009,
2009 Third International Conference on Sensor Technologies and Applications.
[4]
Kai Qian,et al.
A smart routing scheme for wireless sensor networks
,
2010,
2010 IEEE International Conference on Wireless Information Technology and Systems.