KMS Chongqing Institute of Green and Intelligent Technology, CAS
TCDM: Effective Large-Factor Image Super-Resolution via Texture Consistency Diffusion | |
Zhang, Yan1,2; Liu, Hanqi1; Li, Zhenghao3; Gao, Xinbo1; Shi, Guangyao1; Jiang, Jianan1 | |
2024 | |
摘要 | Recently, remote sensing super -resolution (SR) tasks have been widely studied and achieved remarkable performance. However, due to the complex texture and serious image degeneration, the conventional methods (e.g., convolutional neural network (CNN) -based and GAN-based) cannot reconstruct high -resolution (HR) remote sensing images with a large SR factor (>= x8). In this article, we model the large -factor super -resolution (LFSR) task as a referenced diffusion process and explore how to embed pixelwise constraint into the popular diffusion model (DM). Following this motivation, we propose the first diffusion -based LFSR method named texture consistency diffusion model (TCDM) for remote sensing images. Specifically, we build a novel conditional truncated noise generator (CTNG) in TCDM to simultaneously generate the expectation of posterior probability p(x(t-1)|x(t)) and the truncated noise image. With the predicted truncated noise image, sampling an SR image using CTNG saves nearly 90% processing time compared to the naive DM. Additionally, we design a new denoising process named texture consistency diffusion (TC-diffusion) to explicitly embed pixelwise constraints into the LFSR DM during the training stage. Universal experiments on five commonly used remote sensing datasets demonstrate that the proposed TCDM surpasses the latest SR methods by a large margin and reports new SOTA results on several evaluation metrics. Additionally, the proposed method demonstrates impressive visual quality on reconstructed remote sensing image texture and details. |
关键词 | Remote sensing Image reconstruction Task analysis Superresolution Transformers Faces Image restoration Diffusion models (DMs) large-factor image super-resolution (SR) remote sensing images texture consistency |
DOI | 10.1109/TGRS.2024.3358913 |
发表期刊 | IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING |
ISSN | 0196-2892 |
卷号 | 62页码:13 |
通讯作者 | Gao, Xinbo(gaoxb@cqupt.edu.cn) |
收录类别 | SCI |
WOS记录号 | WOS:001168626400003 |
语种 | 英语 |