摘要
为解决我省气象信息化发展带来的海量气象数据和产品传输、处理和存储服务等问题,通过分析数据湖(DataLake)技术的特点和技术优势,设计了统一数据湖的思路,解决了我省气象系统海量多源数据存储、管理和共享等问题,统一了文件目录和数据安全管理,有利于打破数据孤岛,提升气象大数据分析和共享能力,更好的发挥气象数据价值。
In view of the problems of massive meteorological data and product transmission,processing and storage services brought about by the development of meteorological informatization in our province,by analyzing the characteristics and technical advantages of data lake technology,the data lake architecture of meteorological system in our province is given,which solves the problems of massive multi-source data storage,management and sharing of meteorological system in our province,and unifies file directories and data security management,which is conducive to breake data islands,improve the quality of meteorological data access in our province,improve the ability of meteorological big data analysis and sharing,and better exert the value of meteorological data.
作者
杨英奎
王祝先
李伟金
YANG Ying-kui;WANG Zhu-xian;LI Wei-jin(Heilongjiang Meteorological Data Center,Haerbin 150030 China;Mingshui County Meteorological Bureau,Suihua 151700 China)
出处
《自动化技术与应用》
2023年第7期91-94,共4页
Techniques of Automation and Applications
关键词
气象信息化
数据湖
气象数据
Meteorological informatization
data lake
Meteorology data
作者简介
杨英奎(1988-),男,硕士,工程师,研究方向:气象系统架构、气象数据加工处理和云计算;通信作者:王祝先(1970-),男,硕士,正高级工程师,研究方向:信息网络技术和大数据研发。
