Cumuliform cloud formation control using parameter-predicting convolutional neural network

Zili Zhang, Yue Ma, Yunfei Li, Frederick W.B. Li, Hubert P.H. Shum, Bailin Yang, Jing Guo, Xiaohui Liang*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

3 Downloads (Pure)


Physically-based cloud simulation is an effective approach for synthesizing realistic cloud. However, generating clouds with desired shapes requires a time-consuming process for selecting the appropriate simulation parameters. This paper addresses such a problem by solving an inverse cloud forming problem. We propose a convolutional neural network, which has the ability of solving nonlinear optimization problems, to estimate the spatiotemporal simulation parameters for given cloud images. The cloud formation process is then simulated by using computational fluid dynamics with these control parameters as initial states. The proposed parameter-predicting model consists of three components, including the feature extraction network, the adversarial network and the parameter generation network. These subnetworks form two parallel branches for different functionality-feature extraction and parameter estimation. To solve the challenge of estimating high-dimensional spatiotemporal simulation parameters, we adapt an encoder and decoder network to compress these parameters into a low-dimensional latent space. We train the proposed deep learning model with pairwise data of time series parameters and the corresponding synthetic images, which are rendered by the density fields of the synthesized clouds under different illuminations. In the practice, our method can simulate physically plausible cloud evolution processes and generate clouds with desired shapes for the real-world and synthetic images.

Original languageEnglish
Article number101083
Number of pages13
JournalGraphical Models
Early online date8 Aug 2020
Publication statusPublished - 1 Sept 2020


Dive into the research topics of 'Cumuliform cloud formation control using parameter-predicting convolutional neural network'. Together they form a unique fingerprint.

Cite this