本文已被:浏览 733次 下载 1659次
Received:January 13, 2021 Revised:February 07, 2021
Received:January 13, 2021 Revised:February 07, 2021
中文摘要: 为解决基于视频流的人体关键点检测效果不佳及视频流切片后可能会发生运动模糊的问题, 提出了一种改进的RetinaNet-CPN网络对人体关键点进行检测, 有效解决切片后运动模糊图像的干扰并提高了人体关键点的检测准确率. 视频流切片后, 先用改进的RetinaNet网络检测出图片中的所有人并对每个目标框做模糊检测, 对大于阈值的目标框做去模糊处理, 最后用引入注意力机制的CPN网络提取关键点. 将RetinaNet衡量预测框与真实框差异的IOU函数改成DIOU后, 在仿真实验中目标检测AP提高了近3%; 对于模糊的图片, 利用匀速直线运动频谱特征估算出的模糊核与实际模糊核相差不大, 对其做去模糊处理后基本能恢复出原清晰图片; 同时引入注意力机制为各通道和特征层分配合理的权重, 使得CPN检测AP提高近1%, AR提升0.5%.
Abstract:Concerning the problem of poor detection of human body keypoints based on video streams and possible motion blur after video stream slicing, an improved RetinaNet-CPN network is proposed to detect the keypoints, avoiding the interference of motion-blurred images after slicing and improving the detection accuracy of the keypoints. After the video stream is sliced, the improved RetinaNet network is first used to detect all the people in the picture and perform fuzzy detection on each target frame. The target frame larger than the threshold is deblurred, and finally, the keypoints are extracted with the CPN network with the attention mechanism. After the IOU function of RetinaNet to measure the difference between the predicted frame and the real frame is changed into DIOU, the target detection AP increases by nearly 3% in the simulation experiment. For blurry pictures, the blur kernel estimated with the spectrum feature of uniform linear motion is slightly different from the actual blur kernel, and the original clear picture can be restored after the deblurring. At the same time, the attention mechanism is adopted to assign reasonable weights to each channel and feature layer, which increases the CPN detection AP by nearly 1% and the AR by 0.5%.
keywords: human body keypoint detection RetinaNet network CPN network fuzzy detection spectrum feature attention mechanism
文章编号: 中图分类号: 文献标志码:
基金项目:浙江省自然科学基金(LQ20F050010)
Author Name | Affiliation | |
BAO Xiao-An | Zhejiang Sci-Tech University, Hangzhou 310018, China | |
JI Peng-Fei | Zhejiang Sci-Tech University, Hangzhou 310018, China | 18861120983@163.com |
Author Name | Affiliation | |
BAO Xiao-An | Zhejiang Sci-Tech University, Hangzhou 310018, China | |
JI Peng-Fei | Zhejiang Sci-Tech University, Hangzhou 310018, China | 18861120983@163.com |
引用文本:
包晓安,吉鹏飞.基于RetinaNet-CPN网络的视频人体关键点检测.计算机系统应用,2021,30(11):138-144
BAO Xiao-An,JI Peng-Fei.Video Human Body Keypoint Detection Based on RetinaNet-CPN Network.COMPUTER SYSTEMS APPLICATIONS,2021,30(11):138-144
包晓安,吉鹏飞.基于RetinaNet-CPN网络的视频人体关键点检测.计算机系统应用,2021,30(11):138-144
BAO Xiao-An,JI Peng-Fei.Video Human Body Keypoint Detection Based on RetinaNet-CPN Network.COMPUTER SYSTEMS APPLICATIONS,2021,30(11):138-144