A Novel Mass Data Processing Framework Based on Hadoop for Electrical Power Monitoring System

The situation and challenge of electrical power monitoring system are summarized in this paper, the electrical power monitoring systems confront the challenge of mass data processing. The open source Apache Hadoop platform is a great choice for solving the problems with petabytes of data. We give a superficial framework based on Hadoop for the power monitoring, and give some suggestions on how to use it.

[1]  Rajkumar Buyya,et al.  MRPGA: An Extension of MapReduce for Parallelizing Genetic Algorithms , 2008, 2008 IEEE Fourth International Conference on eScience.

[2]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[3]  Jun Li,et al.  Application of Integrated Neural Network Based on MATLAB to Fault Diagnosis in Feed Water Pump , 2011, 2011 Asia-Pacific Power and Energy Engineering Conference.

[4]  M. M. Morcos,et al.  Application of AI tools in fault diagnosis of electrical machines and drives-an overview , 2003 .

[5]  Lin Cheng,et al.  A Hybrid Conditions-Dependent Outage Model of a Transformer in Reliability Evaluation , 2009, IEEE Transactions on Power Delivery.

[6]  Jian Xu,et al.  Online Monitoring of Wide-Area Voltage Stability Based on Short Circuit Capacity , 2011, 2011 Asia-Pacific Power and Energy Engineering Conference.

[7]  GhemawatSanjay,et al.  The Google file system , 2003 .

[8]  Albert Claudi,et al.  Online Monitoring of the Electrical Power Transfer Stability and Voltage Profile Stability Margins in Electric Power Transmission Systems Using Phasor Measurement Units Data Sets , 2009, 2009 Asia-Pacific Power and Energy Engineering Conference.

[9]  Weixuan Li,et al.  Online monitoring and fault diagnosis system of Power Transformer , 2010, 2010 Asia-Pacific Power and Energy Engineering Conference.

[10]  Sun Cai-xin,et al.  Artificial Immune Network Classification Algorithm for Fault Diagnosis of Power Transformer , 2007, IEEE Transactions on Power Delivery.

[11]  Bo Yang,et al.  An improved neural network prediction model for load demand in day-ahead electricity market , 2008, 2008 7th World Congress on Intelligent Control and Automation.

[12]  Sun Caixin,et al.  Fault Diagnosis of Power Transformer Using Dynamic Clustering Algorithm , 2008, 2008 International Conference on High Voltage Engineering and Application.

[13]  Ye Zhongming,et al.  A review on induction motor online fault diagnosis , 2000, Proceedings IPEMC 2000. Third International Power Electronics and Motion Control Conference (IEEE Cat. No.00EX435).