基于深度学习LoFTR算法的路面图像拼接
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:


Road Image Mosaic Based on Deep Learning LoFTR Algorithm
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    相比基于特征点的传统图像特征匹配算法, 基于深度学习的特征匹配算法能产生更大规模和更高质量的匹配. 为获取较大范围且清晰的路面裂缝图像, 并解决弱纹理图像拼接过程中发生的匹配对缺失问题, 本文基于深度学习LoFTR (detector-free local feature matching with Transformers)算法实现路面图像的拼接, 并结合路面图像的特点, 提出局部拼接方法缩短算法运行的时间. 先对相邻图像做分割处理, 再通过LoFTR算法产生密集特征匹配, 根据匹配结果计算出单应矩阵值并实现像素转换, 然后通过基于小波变换的图像融合算法获得局部拼接后的图像, 最后添加未输入匹配网络的部分图像, 得到相邻图像的完整拼接结果. 实验结果表明, 与基于SIFT (scale-invariant feature transform)、SURF (speeded up robust features)、ORB (oriented FAST and rotated BRIEF)的图像拼接方法比较, 研究所提出的拼接方法对路面图像的拼接效果更佳, 特征匹配阶段产生的匹配结果置信度更高. 对于两幅路面图像的拼接, 采用局部拼接方法耗费的时间较改进之前缩短了27.53%. 研究提出的拼接方案是高效且准确的, 能够为道路病害监测提供总体病害信息.

    Abstract:

    The feature matching algorithm based on deep learning can produce larger scale and higher quality matching than the traditional algorithm based on feature points. This study aims to obtain a wide range of clear pavement crack images and solve the problem of missing matching pairs in weak texture image mosaics. The road image mosaic is realized based on the deep learning LoFTR (detector-free local feature matching with Transformers) algorithm. Given the characteristics of road images, the local mosaic method is proposed to shorten the running time of the algorithm. Firstly, the segmentation of adjacent images is conducted, and the dense feature matching is produced through the LoFTR algorithm. Secondly, the homography matrix value is calculated according to the matching results and the pixel conversion is realized. Thirdly, images after local mosaics are obtained through the image fusion algorithm based on wavelet transform. Finally, some images that are not input into the matching network are added to get the complete mosaic result of adjacent images. The experimental results show that, compared with methods based on SIFT (scale-invariant feature transform), SURF (speeded up robust features), and ORB (oriented FAST and army), the proposed method has a better effect on road image mosaic and higher confidence of matching results in feature matching stage. For the mosaic of two road images, the time consumed by the local splicing method is shortened by 27.53% compared with that before the improvement. The proposed mosaic scheme is efficient and accurate, which can provide overall disease information for road disease monitoring.

    参考文献
    相似文献
    引证文献
引用本文

张瑞,袁博,杨明,丁健刚,徐政超,李伟.基于深度学习LoFTR算法的路面图像拼接.计算机系统应用,2023,32(2):170-180

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2022-06-14
  • 最后修改日期:2022-07-12
  • 录用日期:
  • 在线发布日期: 2022-09-08
  • 出版日期:
文章二维码
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京海淀区中关村南四街4号 中科院软件园区 7号楼305房间,邮政编码:100190
电话:010-62661041 传真: Email:csa (a) iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号