基于改进MADDPG的UAV轨迹和计算卸载联合优化算法
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

航天高可信嵌入式软件工程技术实验室基金; 西安市碑林区科技计划(GX2137)


Joint Optimization Algorithm for UAV Trajectory and Computational Offloading Based on Improved MADDPG
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    在地震、台风、洪水、泥石流等造成严重破坏的灾区, 无人机(unmanned aerial vehicle, UAV)可以作为空中边缘服务器为地面移动终端提供服务, 由于单无人机有限的计算和存储能力, 难以实时满足复杂的计算密集型任务. 本文首先研究了一个多无人机辅助移动边缘计算模型, 并构建了数学模型; 然后建立部分可观察马尔可夫决策过程, 提出了基于复合优先经验回放采样方法的MADDPG算法(composite priority multi-agent deep deterministic policy gradient, CoP-MADDPG)对无人机的时延能耗以及飞行轨迹进行联合优化; 最后, 仿真实验结果表明, 本文所提出算法的总奖励收敛速度和收敛值均优于其他基准算法, 且可为90%左右的地面移动终端提供服务, 证明了本文算法的有效性与实用性.

    Abstract:

    Unmanned aerial vehicles (UAVs) can act as air edge servers to provide services for ground mobile terminals in disaster areas where earthquakes, typhoons, floods, and mudslides have caused severe damage. However, it is difficult to complete complex computationally intensive tasks in real time due to the limited computation and storage capacity of a single UAV. In this study, a multi-UAV-assisted mobile edge computing model is first investigated and a mathematical model is built. Then a partially observable Markov decision process is established and an improved multi-agent deep deterministic policy gradient (MADDPG) algorithm based on the composite priority experiential replay sampling method (CoP-MADDPG) is proposed to jointly optimize time delay, energy consumption, and flight trajectory of UAVs. Finally, the simulation experimental results show that the proposed algorithm outperforms other benchmark algorithms in terms of total reward convergence speed and convergence value, and can provide services for about 90% of ground mobile terminals, proving the effectiveness and practicality of the proposed algorithm.

    参考文献
    相似文献
    引证文献
引用本文

苏维亚,徐飞,王森.基于改进MADDPG的UAV轨迹和计算卸载联合优化算法.计算机系统应用,2023,32(11):203-211

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2023-04-08
  • 最后修改日期:2023-05-11
  • 录用日期:
  • 在线发布日期: 2023-07-21
  • 出版日期:
文章二维码
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京海淀区中关村南四街4号 中科院软件园区 7号楼305房间,邮政编码:100190
电话:010-62661041 传真: Email:csa (a) iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号