本文已被:浏览 666次 下载 2169次
Received:January 13, 2023 Revised:February 13, 2023
Received:January 13, 2023 Revised:February 13, 2023
中文摘要: 当前主流的图片彩色化方法包括传统算法和深度学习方法. 随着深度学习模型的发展, 基于深度学习的灰度图像彩色化方法能带来更好的着色效果, 但仍然存在细节损失和着色枯燥问题. 针对上述问题, 本文将CycleGAN模型应用在非单一类别的灰度图像彩色化上, 使其在动物、植物、风景等图片上有逼真的着色效果. 模型结构上对CycleGAN模型的激活函数加以改进, 在生成器使用PReLU激活函数, 使模型更易于训练. 在判别器使用PatchGAN提高图片高分辨率上的颜色细节. 通过ImageNet数据集5个热门类别图像的训练后, 模型对动植物与风景图彩色化的效果十分逼真. 在图像评估指标中, 该模型在PSNR中比GAN高了0.603 dB约有2.1%的提升, 在SSIM中明显高于其他模型, 在效果上有5.1%的提升. 从视觉感受来看, 通过CycleGAN彩色化的图片饱和度更高, 在视觉真实性上高于VGG和GAN等模型, 解决了着色枯燥问题, 而且更容易还原图片中的颜色细节, 避免细节损失.
Abstract:The current mainstream image colorization methods include traditional algorithms and deep learning methods. With the development of deep learning models, the grayscale image colorization method based on deep learning can bring better coloring effects, but there is still a loss of details and dull coloring. In order to solve these problems, in this study, the CycleGAN model is applied to the colorization of non-single-category grayscale images, so as to achieve realistic coloring effects on pictures of animals, plants, landscapes, etc. The activation function of the CycleGAN model is improved in terms of model structure, and the PReLU activation function is used in the generator to make the model easier to be trained. This study also uses PatchGAN in the discriminator to improve color details at high resolution in the image. After training on five popular categories of images from the ImageNet dataset, the model’s colorization effect on animals, plants, and landscapes is realistic. In the image evaluation index, the model is 0.603 dB higher than GAN in PSNR, which indicates an improvement of about 2.1%, and it is significantly higher than other models in SSIM, with an improvement of 5.1% in effect. From the perspective of visual perception, the pictures colored by CycleGAN have higher saturation and visual authenticity than models such as VGG and GAN. As a result, the proposed model not only solves the problem of dull coloring but also makes it easier to restore the color details in the picture and avoid the loss of details.
文章编号: 中图分类号: 文献标志码:
基金项目:国家自然科学基金面上项目(62076103)
引用文本:
陈宗楠,叶耀光,潘家辉.基于CycleGAN的灰度图像彩色化方法.计算机系统应用,2023,32(8):126-132
CHEN Zong-Nan,YE Yao-Guang,PAN Jia-Hui.Grayscale Image Colorization Based on CycleGAN.COMPUTER SYSTEMS APPLICATIONS,2023,32(8):126-132
陈宗楠,叶耀光,潘家辉.基于CycleGAN的灰度图像彩色化方法.计算机系统应用,2023,32(8):126-132
CHEN Zong-Nan,YE Yao-Guang,PAN Jia-Hui.Grayscale Image Colorization Based on CycleGAN.COMPUTER SYSTEMS APPLICATIONS,2023,32(8):126-132