|Scalable and Cooperative Big Data Mining Platform Design for Smart Grid|
【Title】Scalable and Cooperative Big Data Mining Platform Design for Smart Grid
【Abstract】Significances and principles of smart grid data mining were analyzed. A scalable and cooperative big data mining platform architecture based on Apache Spark and Jupyter was proposed. The method of integrating Jupyter with Spark was detailed about. A new cooperation mode by collaborating with others through the Linux permission model on JupyterHub, the multiple-user server for Jupyter Notebook, was proposed. A hardware and software platform based on the proposed architecture was established for analyzing power big data. on the platform, all consumer load data of Jiangsu province were clustered through K-means clustering to demonstrate the platform functionalities, the research team members cooperated efficiently. The research practice indicated that the platform achieves high scalability, minimal maintenance, and rapid algorithmic exploration capability, leads to higher productivity of the big data mining applications in smart grids.
【Keywords】big data, data mining, scalable, smart grid, Spark, Jupyter【Author】
|Cheng Tianshi||: School of Electrical Engineering, Southeast University, Nanjing, China;|
|Jiang Wei||: School of Electrical Engineering, Southeast University, Nanjing, China;|
【出版时间】Tue Aug 09 08:00:00 CST 2016
|【浏览数：132】||【收藏数： 0】||【购买数： 0】||【下载数： 0】|