###
计算机系统应用英文版:2021,30(10):109-117
←前一篇   |   后一篇→
本文二维码信息
码上扫一扫!
基于3D-SVD的时空行为定位算法
(1.复旦大学 智能机器人研究院, 上海 200433;2.季华实验室, 佛山 528200;3.智能机器人教育部工程研究中心, 上海 200433;4.吉林省人工智能与无人系统工程研究中心, 长春 130012;5.上海智能机器人工程技术研究中心, 上海 200433)
Spatio-Temporal Action Localization Algorithm Based on 3D-SVD
(1.Institute of AI and Robotics, Fudan University, Shanghai 200433, China;2.Ji Hua Laboratory, Foshan 528200, China;3.Engineering Research Center of AI and Robotics, Ministry of Education, Shanghai 200433, China;4.Engineering Research Center of AI and Unmanned Vehicle Systems of Jilin Province, Changchun 130012, China;5.Shanghai Engineering Research Center of AI and Robotics, Shanghai 200433, China)
摘要
图/表
参考文献
相似文献
本文已被:浏览 772次   下载 2001
Received:January 06, 2021    Revised:February 07, 2021
中文摘要: 随着摄像头的普及, 基于人工智能的行为分析技术在智能视频领域扮演着越来越重要的角色. 现有的算法大多采用光流网络或者3D网络来获取行为的时间信息, 但是光流网络和一般的3D网络计算量大, 在同时进行分类和定位这两项任务时计算效率低. 针对这一问题, 本文构建了一个能够进行空间定位和分类的双流框架, 在3D网络分支中采用SVD的思想分解3D卷积核以减少3D网络的参数, 并利用动态规划算法高效的搜索最佳行为管道, 在训练的过程中采用mixup算法对数据集进行扩充, 增强训练的效果. 最后, 在UCF101-24和J-HMDB-21这两个被广泛使用的行为定位数据集上进行了实验验证, 相比于基线算法, 两个数据集的Frame-mAP分别提高了7.1%和4.8%, 其中, J-HMDB-21在不同IOU下的Video-mAP分别提高了5.2%和4.8%. 实验结果表明, 本文提出的算法能有效提高行为定位能力, 与其它算法相比获得了较好的结果.
中文关键词: 行为定位  SVD  数据增强  行为管道
Abstract:With the popularity of video surveillance, action analysis technology based on artificial intelligence is playing an increasingly important role in the field of intelligent surveillance. Most of the existing algorithms depend on an optical flow network or a 3D network to obtain the time information of actions. However, the optical flow network and the general 3D network require a large amount of computation, and the computational efficiency is low when classification and localization are carried out simultaneously. To solve this problem, this study builds a dualflow framework capable of spatial localization and classification and follows the idea of SVD to decompose the 3D convolution kernel in the branch of the 3D network, thus reducing the 3D network parameters. In addition, the dynamic programming algorithm is employed to efficiently search the optimal action tubes, and the mixup algorithm is used to expand the data sets during training, thereby enhancing the training results. Finally, experimental verification is carried out on UCF101-24 and J-HMDB-21, two widely used data sets for action localization. Compared with the baseline algorithm, the Frame-mAP of the two data sets is improved by 7.1% and 4.8%, and the Video-mAP of J-HMDB-21 under different IoUs is enhanced by 5.2% and 4.8%. Experimental results show that the proposed algorithm can substantially improve the ability of action localization, with better results compared with other algorithms.
文章编号:     中图分类号:    文献标志码:
基金项目:上海市科委项目(19511132000)
引用文本:
王紫烟,张立华,翟鹏,杜洋涛.基于3D-SVD的时空行为定位算法.计算机系统应用,2021,30(10):109-117
WANG Zi-Yan,ZHANG Li-Hua,ZHAI Peng,DU Yang-Tao.Spatio-Temporal Action Localization Algorithm Based on 3D-SVD.COMPUTER SYSTEMS APPLICATIONS,2021,30(10):109-117