Improved Hadoop-based cloud for complex model simulation optimization: Calibration of SWAT as an example

	Improved Hadoop-based cloud for complex model simulation optimization: Calibration of SWAT as an example; Improved Hadoop-based cloud for complex model simulation optimization_ Calibration of SWAT as an example.pdf
	Ma, Jinfeng; Rao, Kaifeng; Li, Ruonan; Yang, Yanzheng; Li, Weifeng; Zheng, Hua
	2022-03
Source Publication	ENVIRONMENTAL MODELLING & SOFTWARE
ISSN	1364-8152
Volume	149 Issue:0 Pages:105330
Abstract	A simulation optimization framework requires a substantial number of model simulations, which are computationally intensive and may be impractical when the model simulations are extremely time-consuming. This paper presents an improved Hadoop-based cloud framework to alleviate the computational burden of optimization. The framework parallelizes conventional sequential-model-based optimization techniques by concurrently orchestrating multiple model computations within Hadoop MapReduce. It guarantees the reliability of simulation optimization tasks by handling node failures without affecting the ongoing simulation. A case study, using Bayesian optimization to calibrate a SWAT model, achieved a speedup of nearly 55-58 when using 100 cores, demonstrating the efficiency of parallelizing the Bayesian optimization algorithm on the Hadoop-based cloud. Experiments in which computing nodes were dynamically increased or decreased demonstrated that the framework can automatically rebalance the workload across the remaining nodes. The framework is readily adaptable to other complex model applications that perform sequential-model-based optimizations or large-scale simulations.
Department	城市与区域生态国家重点实验室;大气环境与污染控制实验室 ; 城市与区域生态国家重点实验室;大气环境与污染控制实验室
Keyword	MULTIOBJECTIVE EVOLUTIONARY ALGORITHM NONPOINT-SOURCE POLLUTION AUTOMATIC CALIBRATION UNCERTAINTY ANALYSIS WATER-QUALITY MANAGEMENT-PRACTICES HYDROLOGIC-MODELS MULTIPLE SOFTWARE INPUT
Document Type	期刊论文
Identifier	https://ir.rcees.ac.cn/handle/311016/47284
Collection	城市与区域生态国家重点实验室
Corresponding Author	Zheng, Hua
Affiliation	1.Chinese Acad Sci, State Key Lab Urban & Reg Ecol, Res Ctr Ecoenvironm Sci, Shuangqing Rd 18, Beijing 100085, Peoples R China 2.Chinese Acad Sci, State Key Joint Lab Environm Simulat & Pollut Con, Res Ctr Ecoenvironm Sci, Beijing 100085, Peoples R China 3.Univ Chinese Acad Sci, Beijing 100049, Peoples R China
Recommended Citation GB/T 7714	Ma, Jinfeng,Rao, Kaifeng,Li, Ruonan,et al. Improved Hadoop-based cloud for complex model simulation optimization: Calibration of SWAT as an example, Improved Hadoop-based cloud for complex model simulation optimization_ Calibration of SWAT as an example.pdf[J]. ENVIRONMENTAL MODELLING & SOFTWARE,2022,149(0):105330.
APA	Ma, Jinfeng,Rao, Kaifeng,Li, Ruonan,Yang, Yanzheng,Li, Weifeng,&Zheng, Hua.(2022).Improved Hadoop-based cloud for complex model simulation optimization: Calibration of SWAT as an example.ENVIRONMENTAL MODELLING & SOFTWARE,149(0),105330.
MLA	Ma, Jinfeng,et al."Improved Hadoop-based cloud for complex model simulation optimization: Calibration of SWAT as an example".ENVIRONMENTAL MODELLING & SOFTWARE 149.0(2022):105330.

Files in This Item:
There are no files associated with this item.

If you have any objections to this item, please fill out the form below and the administrator will contact you as soon as possible.
Content:
Email：	*
Institution:
Verification Code:	Refresh

Any comments and suggestions are welcomed.
Title:	*
Content:
Email：	*
Verification Code:	Refresh

城市与区域生态国家重点实验室知识库