云计算平台上实现30年气候资料整编的方法
    点此下载全文
引用本文:杨润芝,肖卫青,胡开喜,杨昕,王颖,马强.云计算平台上实现30年气候资料整编的方法[J].计算技术与自动化,2013,(3):137-140
摘要点击次数: 1455
全文下载次数: 88
作者单位
杨润芝,肖卫青,胡开喜,杨昕,王颖,马强 (1.国家气象信息中心系统工程室,北京100081
2.国家气象信息中心气象数据研究室,北京100081) 
中文摘要:国家气象信息中心存储和保存了50多年宝贵的长序列历史资料,这些历史资料在实时、准实时业务及科研中需要经常被使用并进行气象科学计算。由于历史数据量大,耗时长,如何在短时间内得到所需的计算结果提供用户使用成为本文的主要研究目标。通过搭建云计算平台,并以30年气候资料统计整编研究对象,在云计算平台上基于MapReduce分布式并行计算模型进行多种统计项目、统计方法的算法实现。通过修改云计算平台运行环境参数配置并在不同配置下运行相同计算任务,进行计算效率对比试验。
中文关键词:云计算  Hadoop  MapReduce计算模型  气候资料整编
 
Method for Thirty-years Climate Normals Generation Based on Cloud-computation Platform
Abstract:Cloud computation technologies, which has solved the problem of low computation power of a stand-alone server, uses distributed computation technology to achieve the computation power of parallel computation and computational efficiency. National Meteorological Information Centre has stored and saved more than fifty years of valuable and precious long sequence of historical data, which often be used in real-time, near-real-time business and research needs and meteorological scientific computation. The amount of historical data is so large and the time of consuming is so long that it has become the main target of this paper to solve how to get the required calculation results in a short or limited time. Based on Hadoop cloud computation platform this paper has built a cluster mode and take the thirty years of climate statistics reorganization for example, realizes a variety of statistical methods and statistical method algorithm using MapReduce computation model. This paper also modifies the Hadoop cluster environment configurations, by starting a different number of task nodes to record different computational efficiency comparison data.
keywords:cloud computation  Hadoop  MapReduce  climate normals
查看全文   查看/发表评论   下载pdf阅读器