基于电力系统大数据治理的软件数据平台设计与研究 |
点此下载全文 |
引用本文:曹明良1?覮,李国和1,冯峥2,郭阳1,罗艳1,李晋先3.基于电力系统大数据治理的软件数据平台设计与研究[J].计算技术与自动化,2020,(3):135-139 |
摘要点击次数: 290 |
全文下载次数: 0 |
|
|
中文摘要:针对电力系统中出现的数据种类多、寻找困难等问题,提出了新型的大数据治理方法。该方法设计出新型的S-BDMP数据软件平台,该平台应用Hadoop分布式存储方式和Spark计算技术实现电力系统中各种大数据的存储和计算。在架构上,该软件平台集成设计有应用程序、数据服务中心、数据提成/合成模块、数据分析模块,能够实现底层电力设备各种数据的接收、存储和处理。本研究还应用随机矩阵理论挖掘各种大数据之间的关联,通过发现电力系统不同大数据之间的关系,进而研究出电力系统设备运行状态的分析。试验表明,本研究的方法效果直观,数据治理程度强。 |
中文关键词:大数据治理 Hadoop分布式存储 Spark计算技术 随机矩阵理论 |
|
Design and Research of Software Data Platform Based on Power System Big Data Governance |
|
|
Abstract:Aiming at the problems of various types of data and difficulty in searching in the power system,a new type of big data governance method is proposed. This method designs a new S-BDMP data software platform,which applies Hadoop distributed storage and Spark computing technology to realize the storage and calculation of various big data in the power system. In terms of architecture,the software platform is integrated and designed with applications,data service centers,data commission/synthesis modules,and data analysis modules,which can realize the reception,storage and processing of various data from the underlying power equipment. This research also uses random matrix theory to mine the associations between various big data,and through discovering the relationship between different big data in the power system,and then study the analysis of the operation status of the power system equipment. Experiments show that the method is intuitive and has a strong degree of data governance. |
keywords:big data governance hadoop distributed storage Spark computing teehnology random matrix theory |
查看全文 查看/发表评论 下载pdf阅读器 |