本文已被:浏览 924次 下载 1933次
Received:December 24, 2020 Revised:January 25, 2021
Received:December 24, 2020 Revised:January 25, 2021
中文摘要: 由于手持拍摄设备抖动或目标运动等原因, 使得视频图像资料产生运动模糊问题, 降低了人类的感知质量. 针对该问题从原来如何处理得到清晰图像, 到现在如何高效快捷的获得清晰图像, 提出了一种基于轻量级GAN(Generative Adversarial Network) 的实时视频图像去模糊新模型. 该模型通过定义PatchGAN作为判别网络, 并在其基础上设置了全局图像和局部特征的双尺度判别器; 生成网络以轻量级MobileNetV3为主干网并引入特征金字塔进行特征提取, 以解决判别网络中特征信息利用率低以及生成网络推理效率慢的问题. 该模型采用端到端的方式对视频图像进行快速高效去模糊. 经过在GoPro和Kohler数据集上进行实验, 结果表明该模型去模糊后的锐利图像具有较高的峰值信噪比和结构相似度, 同时比其他模型的推理速度提高了1.7–127倍.
中文关键词: 实时视频图像去模糊 轻量级 GAN 特征金字塔 MobileNetV3
Abstract:Due to the shaking of a handheld camera or the movement of targets, the video image data is subject to motion blur, which reduces the image quality of human perception. With regard to the problem, from how to obtain clear images from the original process to how to obtain clear images efficiently, a new model for real-time video image deblurring based on the lightweight Generative Adversarial Network (GAN) is proposed in this study. The model defines PatchGAN as a discriminant network and sets up a dual-scale discriminator for global images and local features on the basis of it; the generation network takes lightweight MobileNetV3 as the backbone network and introduces a feature pyramid for feature extraction to solve the problem of low utilization of feature information in the discrimination network and low inference efficiency of the generation network. This model uses an end-to-end approach to efficiently deblur the video image. After experiments on the GoPro and Kohler datasets, the results show that the sharp image deblurred by this model has a high peak signal-to-noise ratio and great structural similarity, and the inference speed reaches 1.7–127 times faster than that of other models.
keywords: real-time video image deblurring lightweight Generative Adversarial Network (GAN) feature pyramid MobileNetV3
文章编号: 中图分类号: 文献标志码:
基金项目:山西省重点研发计划(重点)高新领域项目(201703D111027); 山西省重点研发计划(201803D121048, 201803D121055)
引用文本:
贾凡,张英俊,谢斌红.基于轻量级GAN的实时视频图像去模糊模型.计算机系统应用,2021,30(10):31-39
JIA Fan,ZHANG Ying-Jun,XIE Bin-Hong.Real-Time Video Image Deblurring Model Based on Lightweight GAN.COMPUTER SYSTEMS APPLICATIONS,2021,30(10):31-39
贾凡,张英俊,谢斌红.基于轻量级GAN的实时视频图像去模糊模型.计算机系统应用,2021,30(10):31-39
JIA Fan,ZHANG Ying-Jun,XIE Bin-Hong.Real-Time Video Image Deblurring Model Based on Lightweight GAN.COMPUTER SYSTEMS APPLICATIONS,2021,30(10):31-39